Future professionals should be prepared for scientific reasoning, i.e., to construct and apply scientific knowledge, in order to analyze and solve problems in their professional practice. Yet, future practitioners’ scientific reasoning skills often seem to be deficient when solving practical problems. This dissertation explores to what extent collaboration may foster the engagement of future practitioners in scientific reasoning: i.e., in epistemic processes and in referring to scientific content knowledge. Therefore, two studies were conducted to compare collaborative and individual problem solving (...) of pre-service teachers regarding their scientific reasoning. Study 1 investigates the effect of group heterogeneity with respect to problem solving scripts on scientific reasoning. Study 2 explores to what extent Epistemic Network Analysis can serve as a methodological approach for measuring scientific reasoning. As part of Study 1, pre-service teachers solved an educational problem either as individuals or as pairs. Collaboration showed a mixed effect on scientific reasoning processes: pairs engaged more in explaining and reasoning about the problem and drew more conclusions, while individuals engaged more in generating solutions. Additional analyses showed that the more heterogeneous pairs were regarding their members’ problem solving scripts the more they engaged in hypothesizing and evaluating evidence and the less they engaged in generating solutions. Finally, pairs less often referred to scientific content than individuals did during problem solving. Study 2 further analyzed the data by applying Epistemic Network Analysis. This method has the advantage of analyzing patterns of connections between epistemic processes, i.e., epistemic networks of scientific reasoning. The central epistemic process for pairs was evidence evaluation, which they frequently used in combination with hypothesizing and communicating and scrutinizing. On the other hand, the most characteristic process in individuals’ scientific reasoning was solution generation, which very often co-occurred with hypothesizing and evidence evaluation. The overall results indicate that if the aim is to develop a more reflective understanding of the problem, future practitioners should collaborate with each other, especially in heterogeneous settings. However, they should be supported to share knowledge regarding scientific theories and evidence as well as to reach a mutual understanding on the problem after a certain time so as to be able to have the capacity of generating solutions. Moreover, the different effects of collaboration on the process and content aspects of scientific reasoning imply that scientific reasoning might not be a unidimensional construct, and its process and content levels should be differentiated in future research. A further important methodological implication is that the process aspect of scientific reasoning can be analyzed as a network of interconnected skills and such analysis might bring more explanatory value than the mere reliance on frequencies of occurrences of isolated activities. (shrink)

The purpose of this paper is to provide a detailed technical protocol analysis of chess masters' evaluative expertise, paying particular attention to the analysis of the structure of their memory process in evaluating foreseen possibilities in games of dynamic equilibrium. The paper has two purposes. First, to publish a results chapter from my DPhil thesis (in revised journal article form) attending to the measurement of foresight in chess masters' evaluation process, testing alternative theories of cognitive expertise in the domain of (...) chess; and second to provide a subset of the technical graphical analysis that corresponds to that measurement to preserve this protocol analysis for access in the academic domain for future studies of expert memory and foresight (e.g., Ericsson & Simon, 1993). The step-by-step protocol analysis consists of: (i) an introduction to foresight cognition as hypothesis testing, (ii) a theoretical review in the domain of chess masters' expertise according to the theoretical frameworks in that field purporting hypotheses relevant to chess masters' evaluative skill processes, and (iii) summary tables and non-parametric statistical analysis corroborating chunking theory frameworks of expert cognition (e.g., DeGroot, 1965; Newell & Simon, 1972; Gobet, 1998; Gobet et al., 2004), and refuting the alternative search-evaluation models (e.g., Holding & Reynolds, 1982). Moreover, the journal article espouses the preservation of the traditional protocol analysis method core to the field of expert cognition (DeGroot, 1969; Kotov, 1971). The full protocol analysis can be found in monograph form here on my SSRN profile in ‘The role of falsification in hypothesis testing’. It takes the form of a specialist population study (e.g., detailed case study work; Luria, 1987). Thus the outline consists of a short introduction, a theoretical methodological review discussing protocol analysis methods for specialist population studies in cognition (with particular attention to the preservation of protocol analysis methods for chess studies in cognition and expert memory/ with a fresh angle on the foresight process), and the full set of protocol analyses with corresponding problem behaviour graphs. A subset of the main results has been published elsewhere (e.g., Cowley & Byrne, 2004; Cowley 2006), receiving scientific and scientific journalistic acclaim (e.g., Nature Online News 2004). (shrink)

In three empirical studies we examined how people reason about prior convictions in child abuse cases. We tested whether the disclosure of similar prior convictions prompts a mental representation or an additive probative value (Criminal Justice Act, 2003). Asymmetrical use of similar priors were observed in three studies. A pilot study showed that disclosure of a second prior did not contribute a weight equivalent to that of the first disclosure. Study 1 showed jurors did not see left-handed evidence (i.e. matching (...) victim bruising) as more indicative of guilt than right-handedness unless a prior conviction was present, and the presence of priors suppressed the generation of alternative possibilities indicative of innocence. Study 2 showed that disclosure did not decrease community ratings of reoffending propensity and dangerousness as much as a similar prior conviction increased them. We consider the results in the context of a new psychological theory of prior conviction bias and the consequences for the implementation of Section 100 of the Criminal Justice Act (2003). (shrink)

Self-generation of knowledge can activate deeper cognitive processing and improve long-term retention compared to the passive reception of information. It plays a distinctive role within the concept of inquiry-based learning, which is an activity-oriented, student-centered collaborative learning approach in which students become actively involved in knowledge construction. This approach allows students to not only acquire content knowledge, but also an understanding of investigative procedures/inquiry skills – in particular the control-of-variables strategy (CVS). From the perspective of cognitive load theory, generating answers (...) and solutions during inquiry-based learning is inefficient as it imposes an intrinsic and extraneous load on learners. Previous research on self-generation of content knowledge in inquiry-based learning has demonstrated that (1) a high cognitive load impairs retention of the generated information, (2) feedback is a fundamental requirement for self-generation of complex content knowledge, (3) self-generation success is key to long-term retention and (4) generating and rereading place different demands on learners. However, there is still no research on the self-generation of scientific reasoning skills and the interaction between the retention of these skills with prior knowledge, feedback and self-generation success. That is why this experiment was conducted. The focus of this research is to analyze the distinctive role of self-generation of scientific reasoning skills within the concept of inquiry-based learning and to identify the influence of prior knowledge and self-generation success on short-term and long-term retention. For this purpose, an experiment involving 133 6th and 7th graders was conducted. An inquiry activity that included the self-generation of scientific reasoning skills was compared to an inquiry task that had students simply read information about the experimental design. We used both an immediate and a delayed test to examine which treatment better developed a deeper understanding of CVS and an ability to apply this knowledge to novel problems (transfer). Direct instruction was clearly superior to self-generation in facilitating students’ acquisition of CVS immediately after the inquiry task. However, after a period of one week had elapsed, both treatment conditions turned out to be equally effective. A generation effect was only found among students with high self-generation success after a 1-week delay. (shrink)

Collecting information that one expects to be useful is a powerful way to facilitate learning. However, relatively little is known about how people decide which information is worth sampling over the course of learning. We describe several alternative models of how people might decide to collect a piece of information inspired by “active learning” research in machine learning. We additionally provide a theoretical analysis demonstrating the situations under which these models are empirically distinguishable, and we report a novel empirical study (...) that exploits these insights. Our model-based analysis of participants' information gathering decisions reveals that people prefer to select items which resolve uncertainty between two possibilities at a time rather than items that have high uncertainty across all relevant possibilities simultaneously. Rather than adhering to strictly normative or confirmatory conceptions of information search, people appear to prefer a “local” sampling strategy, which may reflect cognitive constraints on the process of information gathering. (shrink)

We propose another positive illusion that fits with McKay & Dennett's (M&D's) criteria for adaptive misbeliefs. This illusion is pervasive in adult reasoning but we focus on its prevalence in children's developing theories. It is a strongly held conviction arising from normal functioning of the doxastic system that confers adaptive advantage on the individual.

This paper describes an abductive process model of anomalous data integration. The model makes use of the entrenchment of the current explanation and the probability of alternative explanations. It is hypothesised that increasing confirmation of the anom-aly itself increases the probability of alternative explanations. In an experimental study we found that both the entrenchment of an existing explanation and confirmation of the anomaly clearly influence how people resolve anomalous data. These results are in agreement with the predic-tions of the model.

Despite the accumulation of substantial cognitive science research relevant to education, there remains confusion and controversy in the application of research to educational practice. In support of a more systematic approach, we describe the Knowledge-Learning-Instruction (KLI) framework. KLI promotes the emergence of instructional principles of high potential for generality, while explicitly identifying constraints of and opportunities for detailed analysis of the knowledge students may acquire in courses. Drawing on research across domains of science, math, and language learning, we illustrate the (...) analyses of knowledge, learning, and instructional events that the KLI framework affords. We present a set of three coordinated taxonomies of knowledge, learning, and instruction. For example, we identify three broad classes of learning events (LEs): (a) memory and fluency processes, (b) induction and refinement processes, and (c) understanding and sense-making processes, and we show how these can lead to different knowledge changes and constraints on optimal instructional choices. (shrink)

The present study discusses findings that replicate and extend the original work of Burns and Vollmeyer (2002), which showed that performance in problem solving tasks was more accurate when people were engaged in a non-specific goal than in a specific goal. The main innovation here was to examine the goal specificity effect under both observation-based and conventional action-based learning conditions. The findings show that goal specificity affects the accuracy of problem solving in the same way, both when the learning stage (...) of the task is observationbased and when it is action-based. Additionally, the findings show that, when instructions do not promote goal specificity, observation-based problem solving is as effective as action-based problem solving. (shrink)

We focus on Karmiloff-Smith's Representational redescription model, arguing that it poses some problems concerning the architecture of a redescribing system. To discuss the topic, we consider the implicit/explicit dichotomy and the relations between natur al language and the language of thought. We argue that the model regards how knowledge is employed rather than how it is represented in the system.

How do expert performers practice as they develop creatively? This study investigated the processes involved in the practice of new skills by expert breakdancers. A great deal of evidence supports the theory of “deliberate practice” (Ericsson, Krampe, & Tesch‐Römer, 1993,Psychological Review, 100,363) in skill acquisition; however, expert creative performers may emphasize other forms of practice for skill development. Four case studies collected through fieldwork and laboratory observation were analyzed to evaluate expert dancers’ practice processes as they developed proficiency in new, (...) specific skills. We focused on three aspects of learning: the degree of skill acquisition, the content of skills included in practice, and dancers’ stated purposes for practicing. The results showed that dancers’ practice improved skills (as suggested by deliberate practice) and engaged the exploration of new, original skills, along with coordinating skills within performance. In their practice, these dance experts went beyond deliberative practice to highly exploratory processes for skill development. (shrink)

The term conceptual simulation refers to a type of everyday reasoning strategy commonly called “what if” reasoning. It has been suggested in a number of contexts that this type of reasoning plays an important role in scientific discovery; however, little direct evidence exists to support this claim. This article proposes that conceptual simulation is likely to be used in situations of informational uncertainty, and may be used to help scientists resolve that uncertainty. We conducted two studies to investigate the relationship (...) between conceptual simulation and informational uncertainty. Study 1 was an in vivo study of expert scientists; the results suggest that scientists do use conceptual simulation in situations of informational uncertainty, and that they use conceptual simulation to make inferences from their data using the analogical reasoning process of alignment by similarity detection. Study 2 experimentally manipulated experts' level of uncertainty and provides further support for the hypothesis that conceptual simulation is more likely to be used in situations of informational uncertainty. Finally, we discuss the relationship between conceptual simulation and other types of reasoning using qualitative mental models. (shrink)

The dynamic constraint relaxation theory predicts crucial roles of the initial diversity and evaluation in creative problem-solving. We reported the experimental evidence supporting these predictions, using an insight problem. The experiments showed that the degrees of making different types of trials and the appropriate evaluation were closely related to individual differences in insight problem-solving, and that evaluation became more appropriate by making the problem-solving goal explicit. The review of the research in related fields showed that these experimental findings were in (...) congruent with the evidence obtained from different types of creative activities. (shrink)

This piece is a commentary on a precis of Maggie Boden's book "The creative mind" published in Behavioral and Brain Sciences.

What is creativity? One new idea may be creative, whereas another is merely new: What's the difference? And how is creativity possible? These questions about human creativity can be answered, at least in outline, using computational concepts. There are two broad types of creativity, improbabilist and impossibilist. Improbabilist creativity involves novel combinations of familiar ideas. A deeper type involves METCS: the mapping, exploration, and transformation of conceptual spaces. It is impossibilist, in that ideas may be generated which – with respect (...) to the particular conceptual space concerned – could not have been generated before. The more clearly conceptual spaces can be defined, the better we can identify creative ideas. Defining conceptual spaces is done by musicologists, literary critics, and historians of art and science. Humanist studies, rich in intuitive subtleties, can be complemented by the comparative rigour of a computational approach. Computational modelling can help to define a space, and to show how it may be mapped, explored, and transformed. Impossibilist creativity can be thought of in “classical” Al terms, whereas connectionism illuminates improbabilist creativity. Most Al models of creativity can only explore spaces, not transform them, because they have no self-reflexive maps enabling them to change their own rules. A few, however, can do so. A scientific understanding of creativity does not destroy our wonder at it, nor does it make creative ideas predictable. Demystification does not imply dehumanization. (shrink)

Previous research on scientific reasoning has shown that it involves a diverse set of skills. Yet, little is known about generality or domain specificity of those skills, an important issue in theories of expertise and in attempts to automate scientific reasoning skills. We present a study designed to test what kinds of skills psychologists actually use in designing and interpreting experiments and contrast expertise within a particular research area with general expertise at designing and interpreting experiments. The results suggest that (...) psychologists use many domain‐general skills in their experimentation and that bright and motivated Carnegie Mellon undergraduates are missing many of these skills. We believe that these results have important implications for psychological and artificial intelligence models of expertise, as well as educational implications in the domain of science instruction. (shrink)

With the advent of computers in the experimental labs, dynamic systems have become a new tool for research on problem solving and decision making. A short review of this research is given and the main features of these systems (connectivity and dynamics) are illustrated. To allow systematic approaches to the influential variables in this area, two formal frameworks (linear structural equations and finite state automata) are presented. Besides the formal background, the article sets out how the task demands of system (...) identification and system control can be realised in these environments, and how psychometrically acceptable dependent variables can be derived. (shrink)

In 1983, Dr. J. Robin Warren and Dr. Barry Marshall reported finding a new kind of bacteria in the stomachs of people with gastritis. Warren and Marshall were soon led to the hypothesis that peptic ulcers are generally caused, not by excess acidity or stress, but by a bacterial infection. Initially, this hypothesis was viewed as preposterous, and it is still somewhat controversial. In 1994, however, a U. S. National Institutes of Health Consensus Development Panel concluded that infection appears to (...) play an important contributory role in the pathogenesis of peptic ulcers, and recommended that antibiotics be used in their treatment. Peptic ulcers are common, affecting up to 10% of the population, and evidence has mounted that many ulcers can be cured by eradicating the bacteria responsible for them. (shrink)

Theories of skill acquisition have made radically different predictions about the role of general problem‐solving methods in acquiring rules that promote effective transfer to new problems. Under one view, methods that focus on reaching specific goals, such as means‐ends analysis, are assumed to provide the basis for efficient knowledge compilation (Anderson, 1987), whereas under an alternative view such methods are believed to disrupt rule induction (Sweller, 1988). We suggest that the role of general methods in learning varies with both the (...) specificity of the problem solver's goal and the systematicity of the strategies used for testing hypotheses about rules. In the absence of a specific goal people are more likely to use a rule‐induction learning strategy, whereas provision of a specific goal fosters use of difference reduction, which tends to be a non‐rule‐induction strategy. We performed two experiments to investigate the impact of goal specificity and systematicity of rule‐induction strategies in learning and transfer within a complex dynamic system. The results of Experiment 1 indicated that during free exploration of a problem space, greater learning occurred if participants adopted more systematic strategies for rule induction, and that participants come to favor such strategies. Experiment 2 revealed that participants who were provided with a specific goal performed well on the initial problem but were impaired on a transfer test using a similar problem with a different goal. Instruction on a systematic rule‐induction strategy facilitated solution for both the initial and transfer problems, but participants' use of this strategy declined if they had a specific goal. Our results support Sweller's (1988) proposal that general problemsolving methods applied to a specific goal foster acquisition of knowledge about an isolated solution path but do not provide an effective way of learning the overall structure of a problem space. We interpret these results in terms of dualspace theories of search through problem space. (shrink)