Why games? How could anyone consider action games an experimental paradigm for Cognitive Science? In 1973, as one of three strategies he proposed for advancing Cognitive Science, Allen Newell exhorted us to “accept a single complex task and do all of it.” More specifically, he told us that rather than taking an “experimental psychology as usual approach,” we should “focus on a series of experimental and theoretical studies around a single complex task” so as to demonstrate that our theories of (...) human cognition were powerful enough to explain “a genuine slab of human behavior” with the studies fitting into a detailed theoretical picture. Action games represent the type of experimental paradigm that Newell was advocating and the current state of programming expertise and laboratory equipment, along with the emergence of Big Data and naturally occurring datasets, provide the technologies and data needed to realize his vision. Action games enable us to escape from our field's regrettable focus on novice performance to develop theories that account for the full range of expertise through a twin focus on expertise sampling and longitudinal studies of simple and complex tasks. (shrink)

The framework of plateaus, dips, and leaps shines light on periods when individuals may be inventing new methods of skilled performance. We begin with a review of the role performance plateaus have played in experimental psychology, human–computer interaction, and cognitive science. We then reanalyze two classic studies of individual performance to show plateaus and dips which resulted in performance leaps. For a third study, we show how the statistical methods of Changepoint Analysis plus a few simple heuristics may direct our (...) focus to periods of performance change for individuals. For the researcher, dips become the marker of exploration where performance suffers as new methods are invented and tested. Leaps mark the implementation of a successful new method and an incremental jump above the path plotted by smooth and steady log–log performance increments. The methods developed during these dips and leaps are the key to surpassing one's teachers and acquiring extreme expertise. (shrink)

This paper provides a detailed account of the origins of the Psycho logical Review in 1894, of the policies and practices of its editors (James Mark Baldwin and James McKeen Cattell) during its first decade, and of the public and private disagreements that led them to dissolve their collaboration in 1904. In doing so, it sheds light on the significant roles played by specialized scientific journals in the development of specific scientific specialities, and illustrates the value for historical exploration of (...) (what anthropologists call) a 'thick description' of (what historians call) 'the fine texture of the past'. It argues that personal factors such as luck and character and temperament often have a greater impact on the way in which science actually evolves than do intellectual interests and concerns, and concludes with an analysis of the overwhelming signifi cance of this episode on the later careers of both Baldwin and Cattell. (shrink)

The study of expertise is difficult to do in a laboratory environment due to the challenge of finding people at different skill levels and the lack of time for participants to acquire mastery. In this paper, we report on two studies that analyze naturalistic gameplay data using cohort analysis to better understand how skill relates to practice and habit. Two cohorts are analyzed, each from two different games. Our work follows skill progression through 7 months of Halo matches for a (...) holistic perspective, but also explores low-level in-game habits when controlling game units in StarCraft 2. Players who played moderately frequently without long breaks were able to gain skill the most efficiently. What set the highest performers apart was their ability to gain skill more rapidly and without dips compared to other players. At the beginning of matches, top players habitually warmed up by selecting and re-selecting groups of units repeatedly in a meaningless cycle. They exhibited unique routines during their play that aided them when under pressure. (shrink)

An empirical study of human expert reasoning processes is presented. Its purpose is to test a model of how a human expert's cognitive system learns to detect, and does detect, pertinent data and hypotheses. This process is called pertinence generation. The model is based on the phenomenon of spreading activation within semantic networks. Twenty‐two radiologists were asked to produce diagnoses from two very difficult X‐ray films. As the model predicted, pertinence increased with experience and with semantic network integration. However, the (...) experts whose daily work involved explicit reasoning were able, in addition, to go beyond and to generate more pertinence. The results suggest that two qualitatively different kinds of expertise, basic and super, should be distinguished. A reinterpretation of the results of Lesgold et al. (1988) is proposed, suggesting that apparent nonmonotonicities in performance are not representative of common radiological expertise acquisition but result from the inclusion of basic and super expertise on the same curve. (shrink)