Psychiatric research is in crisis because of repeated failures to discover new drugs for mental disorders. Lack of measurement validity could partly account for these failures. If researchers do not actually measure the effects of drugs on the disorders they aim to investigate, one should expect suboptimal treatment outcomes. I argue that this is the case, focusing on depression, and fear & anxiety disorders. In doing so, I show how psychiatric research illustrates a more general phenomenon that I call “validity (...) drift.” A validity drift occurs when, in the course of developing new measurement procedures, researchers end up studying something different from what they originally aimed to study. I analyze the different ways in which scientists attempt to validate procedures for measuring mental disorders for the purpose of testing drugs in animal models. I show how those validation efforts might fail, thereby leading to validity drifts. Overall, this analysis highlights the complex interplay between the development of new measurement procedures, their calibration, and scientific theories of the target phenomena. (shrink)

Although researchers agree on the importance of validity, they have not yet reached a consensus on what validity consists of. This article traces the historic trajectories of validity theory development in three research traditions: psychometrics, experiment in social settings, and animal models of psychiatric disorders, showing that the multiplicity in the concept of validity is shaped by its multiple historic trajectories and reflects the diversity of practices and concerns in different research traditions. I argue that specifying validity of what target (...) practice and for what purpose in discussions helps to connect validity to its rich context that gives rise to its specific meaning and relevance. (shrink)

Recent trends in psychiatry involve a transition from categorical to dimensional frameworks, in which the boundary between health and pathology is understood as a difference in degree rather than as a difference in kind. A major tenet of dimensional approaches is that no qualitative distinction can be made between health and pathology. As a consequence, these approaches tend to characterize such a threshold as pragmatic or conventional in nature. However, dimensional approaches to psychopathology raise several epistemological and ontological issues. First, (...) we review major sources of evidence usually recruited in support of the dimensional trend (focusing on clinical observation and biological data), and we show that these are connected to different conceptualizations of how dimensional traits extend across health and pathology. Second, we criticize two unquestioned assumptions that stand at the core of the dimensional trend: a) that there is continuity from health to pathology at the symptomatic level; b) that such continuity reflects an underlying continuity in the genetic liability for pathological conditions. Third, we argue against the idea of a conventional threshold by showing that such a view implies a linear relationship between the genotype and the phenotype. Fourth, drawing on epigenetics and developmental biology, we offer a characterization of mental disorders as stable and dynamic constellations of multi-level variables that differ qualitatively from ‘healthy states’. We conclude by showing that our account has several theoretical advantages over both categorical and dimensional approaches. Notably, it provides crucial insights into psychological development over time and individual differences, with major implications in terms of intervention and clinical decision-making. (shrink)

This paper examines the role existence plays in measurement validity. I argue that existing popular theories of measurement and of validity follow a correspondence framework, which starts by assuming that an entity exists in the real world with certain properties that allow it to be measurable. Drawing on literature from the sociology of measurement, I show that the correspondence framework faces several theoretical and practical challenges. I suggested the validity-first framework of measurement, which starts with a practice-based validation process as (...) the basis for a measurement theory, and only posits objective existence when it is scientifically useful to do so. (shrink)

To study (un)conscious perception and test hypotheses about consciousness, researchers need procedures for determining whether subjects consciously perceive stimuli or not. This article is an introduction to a family of procedures called ‘confidence-based procedures’, which consist in interpreting metacognitive indicators as indicators of consciousness. I assess the validity and accuracy of these procedures, and answer a series of common objections to their use in consciousness research. I conclude that confidence-based procedures are valid for assessing consciousness, and, in most cases, accurate (...) enough for our practical and scientific purposes. (shrink)

The central task of cognitive neuroscience to map cognitive capacities to neural mechanisms faces three interlocking conceptual problems that together frame the problem of cognitive ontology. First, they must establish which tasks elicit which cognitive capacities, and specifically when different tasks elicit the same capacity. To address this operationalization problem, scientists often assess whether the tasks engage the same neural mechanisms. But to determine whether mechanisms are of the same or different kinds, we need to solve the abstraction problem by (...) determining which mechanistic differences are and are not relevant, and also the boundary problem by distinguishing the mechanism from its background conditions. Solving these problems, in turn, requires understanding how cognitive capacities are elicited in tasks. These three problems, which have been noted and discussed elsewhere in the literature, together form a ‘cycle of kinds’ that frames the central problem-space of cognitive ontology. We describe this cycle to clarify the intellectual challenges facing the cognitive ontologist and to reveal the kind of iterative process by which ontological revision in cognitive neuroscience is likely to unfold. (shrink)

Most mainstream psychologists consider philosophy irrelevant to their work, but see themselves as realists. Various opposition movements embrace philosophy but reject realism, either completely or partially, despite upholding ideas consistent with a realist philosophy. Many on both sides see the Tower of Babel that constitutes psychology as a sign of healthy diversity, not fragmentation. We argue that relations among the three factors – philosophy, realism and fragmentation – deserve closer scrutiny. With philosophy’s core method of conceptual analysis deprioritized, both mainstream (...) psychology and the opposition fracture into an array of “partial realisms”, falling away from a realism that is thoroughly consistent. These are the source of psychology’s fragmentation. The conceptual neglect and resulting confusions can be seen in psychology’s recent replicability crisis, and in the widespread adoption of a representationalist approach to the mind/brain. We argue that the metatheoretical coherence and methodological maturity required for genuine scientific progress involves a consistent adherence to realism. We spell out what that involves and consider several reasons why this has been so difficult for psychology. (shrink)

This book proposes guidelines for constructing and evaluating definitions of terms, i.e. words or phrases of general application. The guidelines extend to adoption of nomenclature. The book is meant to be a practical guide for people who find themselves in their daily lives or their employment producing or evaluating definitions of terms. It can be consulted rather than being read through. The book’s theoretical framework is a distinction, due to Robert H. Ennis, of three dimensions of definitions: the act of (...) the definer, the content of the definition, and its form. The act of a definer is what the definer does in defining a term; the book distinguishes, following Ennis, three basic acts of defining: reporting, stipulating, and advocating. The content of a definition is in one sense the information that the definition conveys and in another sense the words in its defining part. The form of a definition is the way it is expressed, for example as a definition by genus and differentia. (shrink)

The success of any election depends on whether it was free and fair both to the candidates and the voters. Due to media coverage of national elections locally, regionally and globally, subtle psychological cues have become popular and are being used in student Representative Council (SRC) elections to harness voter preferences. This study focused on investigating the relationship between subtle psychological cues and voter preferences among university of Zimbabwe students. More so, the study was focused on four operationally defined subtle (...) psychological cues namely Ballot order effects, Hallo effects, Negativity bias and Push polls on whether they would influence the participant’s voter preference. The study takes the form of an experimental research design and is based on a sample of 80 purposefully selected participants. In addition, primary data was gathered using 4 ballot papers with a Likert scale and was analysed using Statistical Package for Social Studies (SPSS) version 23. Descriptive statistics, T-tests for independent samples, Chi-square tests and Pearson correlation were computed to establish the degree of the relationship between the variables in question. Results show that of the four subtle psychological cues under investigation, negativity bias and hallo effects were predominantly popular due to the American presidential debates such as that of Richard Nixon against Kennedy and Barack Obama against Hilary Clinton. In addition the results show no statistically significant group differences on how gender, ethnicity and year of study affected voter preferences. Ultimately, there were three positive correlations for the experiments Ballot order effects, Hallo effects and Negativity bias. However, contrary to the reviewed literature there was a negative correlation between Push polls and voter preferences. The conclusion was that there is statistically significant relationship between subtle psychological cues and voter preferences and hence have the potential to increase or decrease the votes a candidate obtains. Therefore, the University can closely monitor SRC elections and make sure the students do not abuse psychological cues such as negativity bias and push polls as they have the potential of ruining the student’s reputations. Also the organisation can add to its current SRC election policies the strategies that were implemented in this study to hold other factors at a constant such as using butterfly ballot paper ordering to help make the free and fair. (shrink)

When it originated in the late 19th century, psychometrics was a field with both a scientific and a social mission: psychometrics provided new methods for research into individual differences, and at the same time, these psychometric instruments were considered a means to create a new social order. In contrast, contemporary psychometrics - due to its highly technical nature and its limited involvement in substantive psychological research - has created the impression of being a value-free discipline. In this article, we develop (...) a contrasting characterization of contemporary psychometrics as a value-laden discipline. We expose four such values: that individual differences are quantitative (rather than qualitative), that measurement should be objective in a specific sense, that test items should be fair, and that utility of a model is more important than its truth. Our goal is not to criticize psychometrics for employing these values, but rather to bring them into the open and to show that these values are not inevitable and are in need of systematic evaluation. (shrink)

Worker well-being is a hot topic in organizations, consultancy and academia. However, too often, the buzz about worker well-being, enthusiasm for new programs to promote it and interest to research it, have not been accompanied by universal enthusiasm for scientific measurement. Aim to bridge this gap, we address three questions. To address the question ‘What is worker well-being?’, we explain that worker well-being is a multi-facetted concept and that it can be operationalized in a variety of constructs. We propose a (...) four-dimensional taxonomy of worker well-being constructs to illustrate the concept’s complexity and classify ten constructs within this taxonomy. To answer the question ‘How can worker well-being constructs be measured?’, we present two aspects of measures: measure obtrusiveness (i.e., the extent to which obtaining a measure interferes with workers’ experiences) and measure type (i.e., closed question survey, word, behavioral and physiological). We illustrate the diversity of measures across our taxonomy and uncover some hitherto under-appreciated avenues for measuring worker well-being. Finally, we address the question ‘How should a worker well-being measure be selected?’ by discussing conceptual, methodological, practical and ethical considerations when selecting a measure. We summarize these considerations in a short checklist. It is our hope that with this study researchers – working in organizations, in academia or both – will feel more competent to find effective strategies for the measurement worker well-being and eventually make policies and choices with a better understanding of what drives worker well-being. (shrink)

When making decisions about action to improve animal lives, it is important that we have accurate estimates of how much animals are suffering under different conditions. The current frameworks for making comparative estimates of suffering all fall along the lines of multiplying numbers of animals used by length of life and amount of suffering experienced. However, the numbers used to quantify suffering are usually generated through unreliable and subjective processes which make them unlikely to be correct. In this paper, I (...) look at how we might apply principled methods from animal welfare science to arrive at more accurate scores, which will then help us in making the best decisions for animals. I argue that a combined use of both a whole-animal measure and a combination measurement framework for assessing welfare will give us the most accurate answers to guide our action. (shrink)

Animal welfare is a concept that plays a role within both our moral deliberations and the relevant areas of science. The study of animal welfare has impacts on decisions made by legislators, producers and consumers with regards to housing and treatment of animals. Our ethical deliberations in these domains need to consider our impact on animals, and the study of animal welfare provides the information that allows us to make informed decisions. This thesis focusses on taking a philosophical perspective to (...) answer the question of how we can measure the welfare of animals. Animal welfare science is an applied area of biology, aimed at measuring animal welfare. Although philosophy of animal ethics is common, philosophy focussing on animal welfare science is rare. Despite this lack, there are definitely many ways in which philosophical methods can be used to analyse the methodologies and concepts used in this science. One of the aims of the work in this thesis is to remedy this lack of attention in animal welfare. Animal welfare science is a strong emerging discipline, but there is the need for conceptual and methodological clarity and sophistication in this science if it is to play the relevant informative role for our practical and ethical decision-making. There is thus is a strong role here for philosophical analysis for this purpose. The central aim of this thesis is to provide an account of how we can measure subjective animal welfare, addressing some of the potential problems that may arise in this particular scientific endeavour. The two questions I will be answering are: what is animal welfare, and how do we measure it? Part One of the thesis looks at the subjective concept of animal welfare and its applications. In it, I argue for a subjective welfare view - that animal welfare should be understood as the subjective experience of individuals over their lifetimes - and look at how the subjective welfare concept informs our ethical decision-making in two different cases in applied animal ethics. Part Two of the thesis looks more closely at the scientific role of welfare. Understanding welfare subjectively creates unique measurement problems, due to the necessarily private nature of mental states and here I address a few of these problems, including whether subjective experience is measurable, how we might validate indicators of hidden target variables such as welfare, how we can make welfare comparisons between individual animals and how we might compare or integrate the different types of experience that make up welfare. I end with a discussion of the implications of all these problems and solutions for the practice of welfare science, and indicate useful future directions for research. (shrink)

This paper looks at the question of what it means for a psychological test to have construct validity. I approach this topic by way of an analysis of recent debates about the measurement of implicit social cognition. After showing that there is little theoretical agreement about implicit social cognition, and that the predictive validity of implicit tests appears to be low, I turn to a debate about their construct validity. I show that there are two questions at stake: First, what (...) level of detail and precision does a construct have to possess such that a test can in principle be valid relative to it? And second, what kind of evidence needs to be in place such that a test can be regarded as validated relative to a given construct? I argue that construct validity is not an all-or-nothing affair. It can come in degrees, because both our constructs and our knowledge of the explanatory relation between constructs and data can vary in accuracy and level of detail, and a test can fail to measure all of the features associated with a construct. I conclude by arguing in favor of greater philosophical attention to processes of construct development. (shrink)

As for most measurement procedures in the course of their development, measures of consciousness face the problem of coordination, i.e., the problem of knowing whether a measurement procedure actually measures what it is intended to measure. I focus on the case of the Perceptual Awareness Scale to illustrate how ignoring this problem leads to ambiguous interpretations of subjective reports in consciousness science. In turn, I show that empirical results based on this measurement procedure might be systematically misinterpreted.

I motivate and articulate a dispositional account of aversive racism. By conceptualizing and measuring attitudes in terms of their full distribution, rather than in terms of their mode or mean preference, my account of dispositional attitudes gives ambivalent attitudes (qua attitude) the ability to predict aggregate behavior. This account can be distinguished from other dispositional accounts of attitude by its ability to characterize ambivalent attitudes such as aversive racism at the attitudinal rather than the sub-attitudinal level and its deeper appreciation (...) of the analogy between traits and attitudes. (shrink)

The success of any election depends on whether it was free and fair both to the candidates and the voters. Due to media coverage of national elections locally, regionally and globally, subtle psychological cues have become popular and are being used in student Representative Council (SRC) elections to harness voter preferences. This study focused on investigating the relationship between subtle psychological cues and voter preferences among university of Zimbabwe students. More so, the study was focused on four operationally defined subtle (...) psychological cues namely Ballot order effects, Hallo effects, Negativity bias and Push polls on whether they would influence the participant’s voter preference. The study takes the form of an experimental research design and is based on a sample of 80 purposefully selected participants. In addition, primary data was gathered using 4 ballot papers with a Likert scale and was analysed using Statistical Package for Social Studies (SPSS) version 23. Descriptive statistics, T-tests for independent samples, Chi-square tests and Pearson correlation were computed to establish the degree of the relationship between the variables in question. Results show that of the four subtle psychological cues under investigation, negativity bias and hallo effects were predominantly popular due to the American presidential debates such as that of Richard Nixon against Kennedy and Barack Obama against Hilary Clinton. In addition the results show no statistically significant group differences on how gender, ethnicity and year of study affected voter preferences. Ultimately, there were three positive correlations for the experiments Ballot order effects, Hallo effects and Negativity bias. However, contrary to the reviewed literature there was a negative correlation between Push polls and voter preferences. The conclusion was that there is statistically significant relationship between subtle psychological cues and voter preferences and hence have the potential to increase or decrease the votes a candidate obtains. Therefore, the University can closely monitor SRC elections and make sure the students do not abuse psychological cues such as negativity bias and push polls as they have the potential of ruining the student’s reputations. Also the organisation can add to its current SRC election policies the strategies that were implemented in this study to hold other factors at a constant such as using butterfly ballot paper ordering to help make the free and fair. (shrink)

Developing self-report Likert scales is an essential part of modern psychology. However, it is hard for psychologists to remain apprised of best practices as methodological developments accumulate. To address this, this current paper offers a selective review of advances in Likert scale development that have occurred over the past 25 years. We reviewed six major measurement journals between the years 1995–2019 and identified key advances, ultimately including 40 papers and offering written summaries of each. We supplemented this review with an (...) in-depth discussion of five particular advances: conceptions of construct validity, creating better construct definitions, readability tests for generating items, alternative measures of precision [e.g., coefficient omega and item response theory information], and ant colony optimization for creating short forms. The Supplementary Material provides further technical details on these advances and offers guidance on software implementation. This paper is intended to be a resource for psychological researchers to be informed about more recent psychometric progress in Likert scale creation. (shrink)

What is a valid measuring instrument? Recent philosophy has attended to logic of justification of measures, such as construct validation, but not to the question of what it means for an instrument to be a valid measure of a construct. A prominent approach grounds validity in the existence of a causal link between the attribute and its detectable manifestations. Some of its proponents claim that, therefore, validity does not depend on pragmatics and research context. In this paper, I cast doubt (...) on the possibility of a context-independent causal account of validity (what I call unconditional validity). I assess several versions, arguing that all of them fail to judge the validity of measuring instruments correctly. Because different research purposes require different properties from measuring instruments, no account of validity succeeds without referring to the specific research purpose that creates the need for measurement in the first place. (shrink)

The use of neuroscientific evidence in criminal trials has been steadily increasing. Despite progress made in recent decades in understanding the mechanisms of psychological and behavioral functioning, neuroscience is still in an early stage of development and its potential for influencing legal decision-making is highly contentious. Scholars disagree about whether or how neuroscientific evidence might impact prescriptions of criminal culpability, particularly in instances in which evidence of an accused’s history of mental illness or brain abnormality is offered to support a (...) plea of not criminally responsible. In the context of these debates, philosophers and legal scholars have identified numerous problems with admitting neuroscientific evidence in legal contexts. To date, however, less has been said about the challenges of evaluating the evidence upon which integrative mechanistic explanations that bring together evidence from different areas of neuroscience are based. As we explain, current criteria for evaluating such evidence to determine its admissibility in legal contexts are inadequate. Appealing to literature in the philosophy of scientific experimentation and theoretical work in the social, cognitive and behavioral sciences, we lay the groundwork for reforming these criteria and identify some of the implications of modifying them. (shrink)

ABSTRACTEmotion understanding, which can broadly be defined as expertise in the meaning of emotion, is a core component of emotional intelligence and facilitates better intra- and interpersonal outcomes. However, to date only very few standard tests to measure emotion understanding in healthy adults exist. Here, we present two new performance-based tests that were developed and are scored based on componential emotion theory and large-scale cross-cultural empirical findings. These instruments intend to measure facets of emotion understanding that are not included in (...) existing tests. The first test measures the ability to understand and label emotional experiences of a target person from a description of emotion features covering five emotion components embedded in a written vignette. The second test measures semantic knowledge about which features from each component a... (shrink)

Milgram’s experiments have had a considerable influence on the historical study of genocidal behavior, which originated with Christopher Browning’s groundbreaking book Ordinary Men. The purpose of my article is to examine and critically assess the following theory which is often taken somewhat for granted: “Relevance thesis: findings in social psychology, most notably Milgram’s findings about obedience behavior, are causally relevant to explaining perpetrators’ behaviors.” The relevance theory presupposes that certain paradigmatic studies in social psychology have both internal and external validity. (...) In the context of the replication crisis which has affected many recent findings in social psychology, it seems crucial to discuss this presupposition. I shall argue that the evidence is mixed. (shrink)

En sciences sociales, les scientifiques utilisent les rapports des sujets sur leurs propres états mentaux dans leurs démarches expérimentales. Ainsi, l’introspection, ou la capacité des sujets à former des croyances sur leurs propres états mentaux, y joue un rôle important. Selon les tenants de l’introspectionnisme, l’introspection est une méthode, certes privée, mais qui permet de justifier directement des hypothèses scientifiques. Ainsi, contrairement aux méthodes utilisées dans les sciences de la nature qui se fondent uniquement sur des données publiques, les sciences (...) sociales utiliseraient des données subjectives pour justifier leurs hypothèses. Contre l’introspectionnisme, nous défendons que l’introspection n’est pas utilisée pour justifier directement les hypothèses, mais que sa place est plutôt similaire à celle d’un instrument de mesure des états et processus mentaux des sujets, susceptible d’être calibré, à la façon dont les instruments de mesure utilisés dans les sciences... (shrink)

Within evolutionary biology, life-history theory is used to explain cross-species differences in allocation strategies regarding reproduction, maturation, and survival. Behavioral scientists have recently begun to conceptualize such strategies as a within-species individual characteristic that is predictive of behavior. Although life history theory provides an important framework for behavioral scientists, the psychometric approach to life-history strategy measurement—as operationalized by K-factors—involves conceptual entanglements. We argue that current psychometric approaches attempting to identify K-factors are based on an unwarranted conflation of functional descriptions and (...) proximate mechanisms—a conceptual mix-up that may generate unviable hypotheses and invites misinterpretation of empirical findings. The assumptions underlying generic psychometric methodology do not allow measurement of functionally defined variables; rather these methods are confined to Mayr’s proximate causal realm. We therefore conclude that K-factor scales lack validity, and that life history strategy cannot be identified with psychometrics as usual. To align theory with methodology, suggestions for alternative methods and new avenues are proposed. (shrink)

This study constructs a measurement scale for Socially Responsible Consumption in the particular context of Colombia. It uses a mixed qualitative and quantitative methodological approach, beginning with four focus groups and ending with a quantitative validation exercise employing Exploratory Factor Analysis. The result is a Socially Responsible Consumption measurement scale consisting of four dimensions that reflect paradigms found in the existing literature. These are, however, expressed differently in Colombia. In particular, Socially Responsible Consumption involves consumer behavior that favors corporate social (...) responsibility practices and the rational consumption of resources and products while recognizing the importance of maintaining a healthy lifestyle through healthcare. (shrink)

Silence in organizations refers to a state in which employees refrain from calling attention to issues at work such as illegal or immoral practices or developments that violate personal, moral, or legal standards. While Morrison and Milliken (Acad Manag Rev 25:706–725, 2000) discussed how organizational silence as a top-down organizational level phenomenon can cause employees to remain silent, a bottom-up perspective—that is, how employee motives contribute to the occurrence and maintenance of silence in organizations—has not yet been given much research (...) attention. In this paper, we argue that this perspective is a meaningful complementation of the existing literature and that it is sensible to conceptualize distinct forms of employee silence (Pinder and Harlos, Research in personnel and human resources management. JAI Press, Greenwich, 2001; van Dyne et al., J Manag Stud 40:1359–1392, 2003). Drawing on past research and theory we conceptualize four forms of employee silence, namely quiescent, acquiescent, prosocial, and opportunistic silence. We present scales to assess the four forms and provide empirical tests for their distinctiveness and patterns of relationships to various correlates and potential antecedents and consequences. (shrink)

Psychological measurement has received strong criticism throughout the history of psychological science. Nevertheless, measurements of attributes such as emotions or intelligence continue to be widely used in research and society. I address this puzzle by presenting a new causal perspective to psychological measurement. I start with assumptions that both critics and proponents of psychological measurement are likely to accept: a minimal causal condition and the observation that most psychological concepts are ill-defined or ambiguous. Based on this, I argue that psychological (...) measurement is fundamentally different from measurement in the physical sciences but can nevertheless be useful. (shrink)

Realism is generally assumed as the correct position with regards to psychological research and the measurement of psychological attributes in psychometrics. Borsboom et al., 203–219 2003), for instance, argued that the choice of a reflective measurement model necessarily implies a commitment to the existence of psychological constructs as well as a commitment to the belief that empirical testing of measurement models can justify their correspondence with real causal structures. Hood :739–761 2013) deemphasized Borsboom et al.’s position and argued that the (...) choice of a reflective measurement model does not necessarily require ontological commitments, though, in his view, it does necessitate a commitment to minimal epistemic realism. Although these arguments are formulated with regard to psychological research, they can actually be generalized to other disciplines in social sciences that use similar methodologies and statistical techniques. In Hood’s opinion, empiricism does not suffice to provide an adequate account of the choice of reflective measurement models given that this choice requires an appeal to causal explanations. In this paper, we argue against Hood and answer this challenge, providing epistemic foundations for social science research that do not appeal to realism. (shrink)

By definition, metacognitive processes may monitor or regulate various stages of first-order processing. By combining causal analysis with hypotheses expressed by other authors we derive the theoretical and methodological consequences of this special relation between metacognition and the underlying processes. In particular, we prove that because multiple processing stages may be monitored or regulated and because metacognition may form latent feedback loops, (1) without strong additional causal assumptions, typical measures of metacognitive monitoring or regulation are confounded; (2) without strong additional (...) causal assumptions, typical methods of controlling for first-order task performance (i.e., calibration, staircase, including first-order task performance in a regression analysis, or analyzing correct and incorrect trials separately) not only do not deconfound measures of metacognition but may even introduce bias; (3) that the first two problems cannot be solved by using simple models of decision-making derived from Signal Detection Theory. We conclude the paper by advocating robust methods of discovering properties of latent mechanisms. (shrink)

Psychologists and philosophers have not yet resolved what they take implicit attitudes to be; and, some, concerned about limitations in the psychometric evidence, have even challenged the predictive and theoretical value of positing implicit attitudes in explanations for social behavior. In the midst of this debate, prominent stakeholders in science have called for scientific communities to recognize and countenance implicit bias in STEM fields. In this paper, I stake out a stakeholder conception of implicit bias that responds to these challenges (...) in ways that are responsive to the psychometric evidence, while also being resilient to the sorts of disagreements and scientific progress that would not undermine the soundness of this call. Along the way, my account advocates for attributing collective (group-level) implicit attitudes rather than individual-level implicit attitudes. This position raises new puzzles for future research on the relationship (metaphysical, epistemic, and ethical) between collective implicit attitudes and individual-level attitudes. (shrink)

There is an increasing push by journals to ensure that data and products related to published papers are shared as part of a cultural move to promote transparency, reproducibility, and trust in the scientific literature. Yet few journals commit to evaluating their effectiveness in implementing reporting standards aimed at meeting those goals (1, 2). Similarly, though the vast majority of journals endorse peer review as an approach to ensure trust in the literature, few make their peer review data available to (...) evaluate effectiveness toward achieving concrete measures of quality, including consistency and completeness in meeting reporting standards. Remedying these apparent disconnects is critical for closing the gap between guidance recommendations and actual reporting behavior. We see this as a collective action problem requiring leadership and investment by publishers, who can be incentivized through mechanisms that allow them to manage reputational risk and through continued innovation in journal assessment. (shrink)

The pivotal problem of comorbidity research lies in the psychometric foundation it rests on, that is, latent variable theory, in which a mental disorder is viewed as a latent variable that causes a constellation of symptoms. From this perspective, comorbidity is a (bi)directional relationship between multiple latent variables. We argue that such a latent variable perspective encounters serious problems in the study of comorbidity, and offer a radically different conceptualization in terms of a network approach, where comorbidity is hypothesized to (...) arise from direct relations between symptoms of multiple disorders. We propose a method to visualize comorbidity networks and, based on an empirical network for major depression and generalized anxiety, we argue that this approach generates realistic hypotheses about pathways to comorbidity, overlapping symptoms, and diagnostic boundaries, that are not naturally accommodated by latent variable models: Some pathways to comorbidity through the symptom space are more likely than others; those pathways generally have the same direction (i.e., from symptoms of one disorder to symptoms of the other); overlapping symptoms play an important role in comorbidity; and boundaries between diagnostic categories are necessarily fuzzy. (shrink)

Psychologists wish to identify and study the mechanisms and implications of nomothetic constructs that reveal truths about human nature and span across operationalizations. To achieve this goal, psychologists should spend more time carefully describing and measuring constructs across a wide range of methods and measures, and less time rushing to explain and predict.

Persons are not just mechanical systems of instinctual animalistic proclivities, but also language-producing, existentially aware creatures, whose experiences and actions are drenched in subjective meaning. To understand a human being as a person is to understand him or her as a rational system that wants, fears, hopes, believes, and in other ways imbues the world with meaning, rather than just a mechanical system that is subject to the same chains of cause and effect as other animals. But contemporary personality psychology (...) has, to a great extent, focused on the behavioral side of personality, while neglecting its meaning side, failing to realize that subjective meanings are part of the very constitution rather than just causes of personality. My overarching purpose with this dissertation is, consequently, to contribute to the establishment of a genuinely non-reductive science of personality that systematically studies the systems of meaning that comprise a person’s worldview in their own right, as sources of meaning in personality. I both establish conceptual and theoretical foundations for the psychology of worldviews and present empirical research on worldviews. The conceptual and theoretical issues are addressed in the introductory chapters and the first paper. I begin by explicating a non-reductive realist philosophy of personality that steers between reductionism and social constructionism, and by suggesting that we need a more coherent understanding of personality and a richer study of it, rather than a radically new methodology. I continue by discussing the limitations of, and conceptual issues with, previous approaches to personality, and by outlining the conceptual foundations for a psychology of worldviews to remediate their weaknesses, demarcating worldview constructs as referring to presuppositions, concepts, and narrative scripts that, by working as the substrata, or background, for intentional thought, feeling, and action, form the most central sources of meaning. I continue by discussing the structure and dynamics of worldviews in terms of the relationship between innate meaning-making mechanisms and the universal features of the existential condition that they address. I conclude the introductory chapters by describing the background of the empirical research and by discussing limitations with the present thesis and directions for future theory and research. I continue, in the first paper, to argue that the study of traits and the study of worldviews form mutually irreducible parts of personality psychology and that worldviews are not inherently less universal in terms of structure, or in other ways less basic, than traits. I conclude this paper by emphasizing the need to address coherence not just in behavior, but also within worldviews and between traits and worldviews, and to complement traditional individual differences research with personalistic methodology. The empirical research is presented in the second and third papers included in this thesis. This research addresses Humanism and Normativism, which are arguably the two broadest and potentially most important worldview constructs in the research literature today, representing whether human beings are thought of as intrinsically valuable and ontologically important or as acquiring value and reality only through the attainment of external norms and ideals . Although originally thought to be opposites, previous research has suggested that they are uncorrelated. In the first empirical paper, I introduce a hierarchical model of their structure, develop scales to measure their facets, and demonstrate through confirmatory factor analysis that they are, contrary to previous wisdom, negatively related in terms of view of human nature, attitude to affect, and interpersonal attitude, but unrelated in terms of epistemology and political values. I present evidence also of discriminant and predictive validity in relation to other worldview variables, life goals, educational field, political and religious orientation, and the Big Five aspects. In the second empirical paper, I use humanism and normativism to explain the broad systems of meaning that potentially underlie, and intersect with, variables from the most important models of the underpinnings of political ideology today, through path modeling. The results suggest that humanism is related to political ideology through preference for equality, as mediated by moral concern with fairness and the avoidance of harm, emotionality, and honesty-humility, and that normativism is related to political ideology through conservative attitudes in general, as mediated by system justification, moral concern with authority, loyalty, and purity, and low openness. Both of the empirical articles provide ample evidence of broad systems of meaning cutting across different aspects of the worldview and of their explanatory power with regards to other psychological phenomena. These studies thereby help to substantiate the viability of the psychology of worldviews. (shrink)

Researchers rely on psychometric principles when trying to gain understanding of unobservable psychological phenomena disconfounded from the methods used. Psychometric models provide us with tools to support this endeavour, but they are agnostic to the meaning researchers intend to attribute to the data. We define method effects as resulting from actions which weaken the psychometric structure of measurement, and argue that solution to this confounding will ultimately rest on testing whether data collected fit a psychometric model based on a substantive (...) theory, rather than a search for a model that best fits the data. We highlight the importance of taking the notions of fundamental measurement seriously by reviewing distinctions between the Rasch measurement model and more generalised 2PL and 3PL IRT models. We then present two lines of research that highlight considerations of making method effects explicit in experimental designs. First, we contrast the use of experimental manipulations to study measurement reactivity during the assessment of metacognitive processes with factor-analytic research of the same. The former suggests differential performance-facilitating and -inhibiting reactivity as a function of other individual differences, whereas factor-analytic research suggests a ubiquitous monotonically predictive confidence factor. Second, we evaluate differential effects of context and source on within-individual variability indices of personality derived from multiple observations, highlighting again the importance of a structured and theoretically grounded observational framework. We conclude by arguing that substantive variables can act as method effects and should be considered at the time of design rather than after the fact, and without compromising measurement ideals. (shrink)

The study of human behavior is severely hampered by logistical problems, ethical and legal constraints, and funding shortfalls. However, the biggest difficulty of conducting social and behavioral research is the extraordinary complexity of the study phenomena. In this article, we review the impact of complexity on research design, hypothesis testing, measurement, data analyses, reproducibility, and the communication of findings in psychological science. The systematic investigation of the world often requires different approaches because of the variability in complexity. Confirmatory testing, multi-factorial (...) designs, survey methods, large samples, and modeling are frequently needed to study complex social and behavioral topics. Complexity impedes the measurement of general constructs, the reproducibility of results and scientific reporting, and the general rigor of research. Many of the benchmarks established by classic work in physical science are not attainable in studies of more complex phenomena. Consequently, the standards used to evaluate scientific research should be tethered to the complexity of the study topic. (shrink)

We describe an approach that enables a more complete evaluation of the validity of emotional intelligence measures. We argue that a source of evidence for validity is often overlooked by researchers and test developers, namely, evidence based on response processes. This evidence can be obtained through a definition of the ability, a description of the mental processes that operate when a person uses the ability, the development of a theory of response behaviour that links variation in the construct with variation (...) on the responses to the items of a measure, and a test of the theory of response behaviour through one or more strategies that we describe. (shrink)

Objective: Theory and research suggest that the pursuit of personal goals that do not fit a person's affect-based implicit motives results in impaired emotional well-being, including increased symptoms of depression. The aim of this study was to evaluate an intervention designed to enhance motive-goal congruence and study its impact on well-being. Method: Seventy-four German students (mean age = 22.91, SD = 3.68; 64.9% female) without current psychopathology, randomly allocated to 3 groups: motivational feedback (FB; n = 25; participants learned about (...) the fit between their implicit motives and explicit goals), FB + congruence-enhancement training (CET; n = 22; participants also engaged in exercises to increase the fit between their implicit motives and goals), and a no-intervention control group (n = 27), were administered measures of implicit motives, personal goal commitments, happiness, depressive symptoms, and life satisfaction 3 weeks before (T1) and 6 weeks after (T2) treatment. Results: On two types of congruence measures derived from motive and goal assessments, treated participants showed increases in agentic (power and achievement) congruence, with improvements being most consistent in the FB+CET group. Treated participants also showed a trend-level depressive symptom reduction, but no changes on other well-being measures. Although increases in overall and agentic motivational congruence were associated with increases in affective well-being, treatment-based reduction of depressive symptoms was not mediated by treatment-based agentic congruence changes. Conclusion: These findings document that motivational congruence can be effectively enhanced, that changes in motivational congruence are associated with changes in affective well-being, and they suggest that individuals’ implicit motives should be considered when personal goals are discussed in the therapeutic process. (shrink)

Silence in organizations refers to a state in which employees refrain from calling attention to issues at work such as illegal or immoral practices or developments that violate personal, moral, or legal standards. While Morrison and Milliken (Acad Manag Rev 25:706–725, 2000) discussed how organizational silence as a top-down organizational level phenomenon can cause employees to remain silent, a bottom-up perspective—that is, how employee motives contribute to the occurrence and maintenance of silence in organizations—has not yet been given much research (...) attention. In this paper, we argue that this perspective is a meaningful complementation of the existing literature and that it is sensible to conceptualize distinct forms of employee silence (Pinder and Harlos, Research in personnel and human resources management. JAI Press, Greenwich, 2001; van Dyne et al., J Manag Stud 40:1359–1392, 2003). Drawing on past research and theory we conceptualize four forms of employee silence, namely quiescent, acquiescent, prosocial, and opportunistic silence. We present scales to assess the four forms and provide empirical tests for their distinctiveness and patterns of relationships to various correlates and potential antecedents and consequences. (shrink)

En sciences sociales, les scientifiques utilisent les rapports des sujets sur leurs propres états mentaux dans leurs démarches expérimentales. Ainsi, l’introspection, ou la capacité des sujets à former des croyances sur leurs propres états mentaux, y joue un rôle important. Selon les tenants de l’introspectionnisme, l’introspection est une méthode, certes privée, mais qui permet de justifier directement des hypothèses scientifiques. Ainsi, contrairement aux méthodes utilisées dans les sciences de la nature qui se fondent uniquement sur des données publiques, les sciences (...) sociales utiliseraient des données subjectives pour justifier leurs hypothèses. Contre l’introspectionnisme, nous défendons que l’introspection n’est pas utilisée pour justifier directement les hypothèses, mais que sa place est plutôt similaire à celle d’un instrument de mesure des états et processus mentaux des sujets, susceptible d’être calibré, à la façon dont les instruments de mesure utilisés dans les sciences de la nature peuvent l’être. (shrink)

Psychological constructs such as personality dimensions or cognitive traits are typically unobserved and are therefore measured by observing so-called indicators of the latent construct. The Common Factor Model models the relations between the observed indicators and the latent variable. In this article we argue in favor of interpreting the CFM as a causal model rather than merely a statistical model, in which common factors are only descriptions of the indicators. When there is sufficient reason to hypothesize that the underlying causal (...) structure of the data is a common cause structure, a causal interpretation of the CFM has several benefits over a merely statistical interpretation of the model. We argue that a causal interpretation conforms with most research questions in which the goal is to explain the correlations between indicators rather than merely summarizing them; a causal interpretation of the factor model legitimizes the focus on shared, rather than unique variance of the indicators; and a causal interpretation of the factor model legitimizes the assumption of local independence. (shrink)