In this paper, we present a competency model for complex problem solving by building on the categories of Knowledge, Skills, Abilities, and Other components. We highlight domain-general and domain-specific components in each of these categories, review established conceptualizations of CPS, and present a new model of CPS competency that is meant to provide a starting point for systematic research on training and assessment. The model highlights the idea that complex problems differ with regard to the KSAO components they demand from (...) a problem solver and that performance in one problem does not necessarily predict performance in a different problem. Implications for research on the training and assessment of CPS competency are discussed, and a selection of well-established tests for various components of the KSAO model is provided. (shrink)

Computer-simulated scenarios have been part of psychological research on problem solving for more than 40 years. The shift in emphasis from simple toy problems to complex, more real-life oriented problems has been accompanied by discussions about the best ways to assess the process of solving complex problems. Psychometric issues such as reliable assessments and addressing correlations with other instruments have been in the foreground of these discussions and have left the content validity of complex problem solving in the background. In (...) this paper, we return the focus to content issues and address the important features that define complex problems. (shrink)

The technological possibilities for new data sources in media psychology, such as online live recordings, called Live Streaming, are growing continuously. These sources do not only offer plentiful quantitative material but also a fairly new access to ecologically valid and unobtrusive observation of problem-solving and decision-making processes. However, to exploit these potentials, epistemological and methodological reflection should guide research. The availability of Big Data and naturally occurring data sets allows to revise the historical controversies on the eligibility of self-description. Drawing (...) on such reflections, media psychology can contribute to renovate well established research methods, such as think aloud protocols, in order to enhance their empirical claims. Apart from other confident attempts to improve these methods, phenomenology and ethnomethodology offer a fruitful account to develop innovative data sources for self-description. Yet, this approach does not support a recurrence of self-description’s previous application but proposes an epistemological shift towards more subtle observations. In order to convey the potentials of media psychology, the risk of repeating classical mistakes, such as introspectionism, have to be regarded. Beyond these fallacies, however, modern digital technology holds encouraging potentials which have already partly been sighted by video gaming research. Due to the similarity of digital environments to laboratory setups, there remains to be a continuity from offline to online research, from traditional data to Big Data. Nevertheless, a true advance into new possibilities requires understanding the qualitative meaning of such data. (shrink)

Empirical methods of self-description, think aloud protocols and introspection have been extensively criticized or neglected in behaviorist and cognitivist psychology. Their methodological value has been fundamentally questioned since there apparently is no suficient proof for their validity. However, the major arguments against self-description can be critically reviewed by theoretical psychology. This way, these methods’ empirical value can be redeemed. Furthermore, self-descriptive methods can be updated by the use of contemporary media technology. In order to support the promising perspectives for future (...) empirical research in the field of cognitive psychology, Live Streaming is proposed as a viable data source. Introducing this new paradigm, this paper presents some of the formal constituents and accessible contents of Live Streaming, and relates them to established forms of empirical research. By its structure and established usage, Live Streaming bears remarkable resemblances to the traditional methods of self-description, yet it also adds fruitful new features of use. On the basis of its qualities, the possible benefits that appear to be feasible in comparison with the traditional methods of self-description are elaborated, such as Live Streaming’s ecological validity. Ultimately, controversial theoretical concepts, such as those in phenomenology and cultural-historical psychology, are adopted to sketch further potential benefits of the utility of Live Streaming in current psychology debates. (shrink)