Cognitive abilities cannot be measured directly. What we can measure is individual variation in task performance. In this paper, we first make the case for why we should be interested in mapping individual differences in task performance on to particular cognitive abilities: we suggest that it is crucial for examining the causes and consequences of variation both within and between species. As a case study, we examine whether multiple measures of inhibitory control for non-human animals do indeed produce correlated task (...) performance; however, no clear pattern emerges that would support the notion of a common cognitive ability underpinning individual differences in performance. We advocate a psychometric approach involving a three-step programme to make theoretical and empirical progress: first, we need tasks that reveal signature limits in performance. Second, we need to assess the reliability of individual differences in task performance. Third, multi-trait multi-method test batteries will be instrumental in validating cognitive abilities. Together, these steps will help us to establish what varies between individuals that could impact their fitness and ultimately shape the course of the evolution of animal minds. Finally, we propose executive functions, including working memory, inhibitory control and attentional shifting, as a sensible starting point for this endeavour. (shrink)

When it originated in the late 19th century, psychometrics was a field with both a scientific and a social mission: psychometrics provided new methods for research into individual differences, and at the same time, these psychometric instruments were considered a means to create a new social order. In contrast, contemporary psychometrics - due to its highly technical nature and its limited involvement in substantive psychological research - has created the impression of being a value-free discipline. In this (...) article, we develop a contrasting characterization of contemporary psychometrics as a value-laden discipline. We expose four such values: that individual differences are quantitative (rather than qualitative), that measurement should be objective in a specific sense, that test items should be fair, and that utility of a model is more important than its truth. Our goal is not to criticize psychometrics for employing these values, but rather to bring them into the open and to show that these values are not inevitable and are in need of systematic evaluation. (shrink)

This study was designed to develop and validate an instrument that can enable researchers and scholars to measure the attitudes of teachers towards learners with disabilities in an inclusive classroom. The study was grounded on the three-components theory of attitude. A series of steps were followed to ascertain the face and content validity of the instrument. Based on the data collected from 532 respondents, preliminary screening was performed, items with weak or high correlation to others were dropped or retained. The (...) construct validity and dimensionality of the instrument was evaluated using Exploratory Factor Analysis (EFA), following the Principal Component Analysis (PCA) extraction, with a varimax rotation based on Eigenvalues greater than one. The results yielded a three-factor solution after suppressing loadings less than .40. These factors were labelled carefully based on the statements of the leading items loading. Cronbach alpha was employed in evaluating the reliability of the instrument, with values ranging from .849 to .938, indicating that the instrument is internally consistent. Consequently, the proposed 36 items instrument was reduced to 30 items. The procedures followed, coupled with the removal of dysfunctional items, resulted in an instrument with appropriate psychometric properties and high reliability for measurement. (shrink)

Spirituality and spiritual well-being are connected with many areas of human life. Thus, especially in secular countries, there is a need for reliable validated instruments for measuring spirituality. The Spiritual Well-Being Scale is among the world’s most often used tools; therefore, the aim of this study was its psychometrical evaluation in the secular environment of the Czech Republic on a nationally representative sample (n = 1797, mean age: 45.9 ± 17.67; 48.6% men). A non-parametric comparison of different sociodemographic groups showed (...) a higher disposition for experiencing spirituality among women, older people, and divorced persons. Based on confirmatory factor analysis, negatively worded items were excluded using a polychoric correlation matrix. The new version of the scale consisting of 11 items had good internal consistency (Cronbach’s α = 0.85; McDonald’s ωt = 0.91). The two-factor model of this shortened version, with factors corresponding to the Religious and the Existential subscales of the Spiritual Well-Being Scale, shows a satisfactory fit with the data, where the loadings of all items ranged from medium to high. Thus, this study offered a new version of the tool, convenient for measuring spiritual well-being in secular conditions. (shrink)

Complex problem solving (CPS) and related topics such as dynamic decision-making (DDM) and complex dynamic control (CDC) represent multifaceted psychological phenomena. In a broad sense, CPS encompasses learning, decision-making, and acting in complex and dynamic situations. Moreover, solutions to problems that people face in such situations are often generated in teams or groups. In turn, this adds another layer of complexity to the situation itself because of the emerging issues that arise from the social dynamics of group interactions. This framing (...) of CPS means that it is not a single construct that can be measured by using a particular type of CPS task (e.g. minimal complex system tests), which is a view taken by the psychometric community. The proposed approach taken here is that because CPS is multifaceted, multiple approaches need to be taken to fully capture and understand what it is and how the different cognitive processes associated with it complement each other. (shrink)

In this paper, we present the results of the construction and validation of a new psychometric tool for measuring beliefs about free will and related concepts: The Free Will Inventory (FWI). In its final form, FWI is a 29-item instrument with two parts. Part 1 consists of three 5-item subscales designed to measure strength of belief in free will, determinism, and dualism. Part 2 consists of a series of fourteen statements designed to further explore the complex network of people’s associated (...) beliefs and attitudes about free will, determinism, choice, the soul, predictability, responsibility, and punishment. Having presented the construction and validation of FWI, we discuss several ways that it could be used in future research, highlight some as yet unanswered questions that are ripe for interdisciplinary investigation, and encourage researchers to join us in our efforts to answer these questions. (shrink)

There has been a recent surge of research interest in videogames of moral engagement for entertainment, advocacy and education. We have seen a wealth of analysis and several theoretical models proposed, but experimental evaluation has been scarce. One of the difficulties lies in the measurement of moral engagement. How do we meaningfully measure whether players are engaging with and affected by the moral choices in the games they play? In this paper, we survey the various standard psychometric instruments from the (...) moral psychology literature and discuss how they might be applied in the evaluation of games. (shrink)

I confront arbitrariness of the sign to a criterion assessing the quality of language, logical system, psychometrics and art.

Should the development of pharmacological cognitive enhancers raise worries about doping in cognitively demanding activities? In this paper, we argue against using current evidence relating to enhancement to justify a ban on cognitive enhancers using the example of chess. It is a mistake to assume that enhanced cognitive functioning on psychometric testing is transferable to chess performance because cognitive expertise is highly complex and in large part not merely a function of the sum specific sub-processes. A deeper reason to doubt (...) that pharmacological cognitive enhancers would be as significant in mind sports is the misleading parallel with physical enhancement. We will make the case that cognitive performance is less mechanical in nature than physical performance. We draw lessons from this case example of chess for the regulation of cognitive enhancement more generally in education and the professions. Premature regulation runs the risk of creating a detrimental culture of suspicion that ascribes unwarranted blame. (shrink)

We explore the question of whether machines can infer information about our psychological traits or mental states by observing samples of our behaviour gathered from our online activities. Ongoing technical advances across a range of research communities indicate that machines are now able to access this information, but the extent to which this is possible and the consequent implications have not been well explored. We begin by highlighting the urgency of asking this question, and then explore its conceptual underpinnings, in (...) order to help emphasise the relevant issues. To answer the question, we review a large number of empirical studies, in which samples of behaviour are used to automatically infer a range of psychological constructs, including affect and emotions, aptitudes and skills, attitudes and orientations (e.g. values and sexual orientation), personality, and disorders and conditions (e.g. depression and addiction). We also present a general perspective that can bring these disparate studies together and allow us to think clearly about their philosophical and ethical implications, such as issues related to consent, privacy, and the use of persuasive technologies for controlling human behaviour. (shrink)

With the advent of computers in the experimental labs, dynamic systems have become a new tool for research on problem solving and decision making. A short review of this research is given and the main features of these systems (connectivity and dynamics) are illustrated. To allow systematic approaches to the influential variables in this area, two formal frameworks (linear structural equations and finite state automata) are presented. Besides the formal background, the article sets out how the task demands of system (...) identification and system control can be realised in these environments, and how psychometrically acceptable dependent variables can be derived. (shrink)

The model of human intelligence that is most widely adopted derives from psychometrics and behavioral genetics. This standard approach conceives intelligence as a general cognitive ability that is genetically highly heritable and describable using quantitative traits analysis. The paper analyzes intelligence within the debate on natural kinds and contends that the general intelligence conceptualization does not carve psychological nature at its joints. Moreover, I argue that this model assumes an essentialist perspective. As an alternative, I consider an HPC theory (...) of intelligence and evaluate how it deals with essentialism and with intuitions coming from cognitive science. Finally, I highlight some concerns about the HPC model as well, and conclude by suggesting that it is unnecessary to treat intelligence as a kind in any sense. (shrink)

Psychologists and philosophers have not yet resolved what they take implicit attitudes to be; and, some, concerned about limitations in the psychometric evidence, have even challenged the predictive and theoretical value of positing implicit attitudes in explanations for social behavior. In the midst of this debate, prominent stakeholders in science have called for scientific communities to recognize and countenance implicit bias in STEM fields. In this paper, I stake out a stakeholder conception of implicit bias that responds to these challenges (...) in ways that are responsive to the psychometric evidence, while also being resilient to the sorts of disagreements and scientific progress that would not undermine the soundness of this call. Along the way, my account advocates for attributing collective (group-level) implicit attitudes rather than individual-level implicit attitudes. This position raises new puzzles for future research on the relationship (metaphysical, epistemic, and ethical) between collective implicit attitudes and individual-level attitudes. (shrink)

We identify several ongoing debates related to implicit measures, surveying prominent views and considerations in each debate. First, we summarize the debate regarding whether performance on implicit measures is explained by conscious or unconscious representations. Second, we discuss the cognitive structure of the operative constructs: are they associatively or propositionally structured? Third, we review debates whether performance on implicit measures reflects traits or states. Fourth, we discuss the question of whether a person’s performance on an implicit measure reflects characteristics of (...) the person who is taking the test or characteristics of the situation in which the person is taking the test. Finally, we survey the debate about the relationship between implicit measures and (other kinds of) behavior. (shrink)

Psychopathy refers to a range of complex behaviors and personality traits, including callousness and antisocial behavior, typically studied in criminal populations. Recent studies have used self-reports to examine psychopathic traits among noncriminal samples. The goal of the current study was to examine the underlying factor structure of the Self-Report of Psychopathy Scale–Short Form (SRP-SF) across complementary samples and examine the impact of gender on factor structure. We examined the structure of the SRP-SF among 2,554 young adults from three undergraduate samples (...) and a high-risk young adult sample. Using confirmatory factor analysis, a four-correlated factor model and a four-bifactor model showed good fit to the data. Evidence of weak invariance was found for both models across gender. These findings highlight that the SRP-SF is a useful measure of low-level psychopathic traits in noncriminal samples, although the underlying factor structure may not fully translate across men and women. (shrink)

Philosophy is a reflective activity. So perhaps it is unsurprising that many philosophers have claimed that reflection plays an important role in shaping and even improving our philosophical thinking. This hypothesis seems plausible given that training in philosophy has correlated with better performance on tests of reflection and reflective reasoning has correlated with demonstrably better judgments in a variety of domains. This article reviews the hypothesized roles of reflection in philosophical thinking as well as the empirical evidence for these roles. (...) This reveals that although there are fairly reliable links between reflection and philosophical judgment among both laypeople and philosophers, the role of reflection in philosophical thinking may nonetheless depend in part on other factors, some of which have yet to be determined. So progress in research on reflection in philosophy may require further innovation in experimental methods and psychometric validation of philosophical measures. (shrink)

Ordinary judgments about personal identity are complicated by the fact that phrases like “same person” and “different person” have multiple uses in ordinary English. This complication calls into question the significance of recent experimental work on this topic. For example, Tobia (2015) found that judgments of personal identity were significantly affected by whether the moral change described in a vignette was for the better or for the worse, while Strohminger and Nichols (2014) found that loss of moral conscience had more (...) of an effect on identity judgments than loss of biographical memory. In each case, however, there are grounds for questioning whether the judgments elicited in these experiments engaged a concept of numerical personal identity at all (cf. Berniūnas and Dranseika 2016; Dranseika 2017; Starmans and Bloom 2018). In two pre-registered studies we validate this criticism while also showing a way to address it: instead of attempting to engage the concept of numerical identity through specialized language or the terms of an imaginary philosophical debate, we should consider instead how the identity of a person is described through the connected use of proper names, definite descriptions, and the personal pronouns “I”, “you”, “he”, and “she”. When the experiments above are revisited in this way, there is no evidence that the differences in question had an effect on ordinary identity judgments. (shrink)

Domestic violence is identified across the globe as a menace as it poses a threat to the mental health of its victims, the significant others of the victim and the security of a nation at large. In some cases, the victim of domestic violence is a pregnant woman and harm is caused not only to a woman but her fetus also and this calls for urgent psychological assessment and intervention. Although there is no doubt that psychological tests are effective in (...) the assessment of domestic violence, using the psychometric properties obtained from a different population may produce generate inaccurate findings. This paper therefore attempts the validation study of Women Abuse Screening Tool (WAST) using a sample of 379 pregnant women attending antenatal clinic at the State Specialist Hospital, Osogbo, Osun State, Nigeria. The study derived a Cronbach’s Alpha Reliability of 0.758, p <.05 and a Guttman split-half coefficient of 0.683, p <.05. Furthermore, concurrent validity of Women Abuse Screening Tool (WAST) and Ongoing Abuse Screen (OAS) was established as 0.29, p<.05. The norms of the instrument were given as 2.38 for tolerable level of domestic violence and 5.79 for severe and pathological level of domestic violence. Authors conclude that Women Abuse Screening Tool has acceptable psychometric properties to justify its usage for the assessment of level of domestic violence among pregnant women in Nigeria and other nations with similar socio-cultural backgrounds. (shrink)

Purpose – This paper aims to extend the companion paper on “infant psychophysics”, which concentrated on the role of in-lab observers (watchers). Infants cannot report their own perceptions, so for five decades their detection thresholds for sensory stimuli were inferred from their stimulus-evoked behavior, judged by watchers. The inferred thresholds were revealed to inevitably be those of the watcher–infant duo, and, more broadly, the entire Laboratory. Such thresholds are unlikely to represent the finest stimuli that the infant can detect. What, (...) then, do they represent? Design/methodology/approach – Infants’ inferred stimulus-detection thresholds are hypothesized to be attentional thresholds, representing more-salient stimuli that overcome distraction. Findings – Empirical psychometric functions, which show “detection” performance versus stimulus intensity, have shallower slopes for infants than for adults. This (and other evidence) substantiates the attentional hypothesis. Research limitations/implications – An observer can only infer the mechanisms underlying an infant’s perceptions, not know them; infants’ minds are “Black Boxes”. Nonetheless, infants’ physiological responses have been used for decades to infer stimulus-detection thresholds. But those inferences ultimately depend upon observer-chosen statistical criteria of normality. Again, stimulus-detection thresholds are probably overestimated. Practical implications – Owing to exaggerated stimulus-detection thresholds, infants may be misdiagnosed as “hearing impaired”, then needlessly fitted with electronic implants. Originality/value – Infants’ stimulus-detection thresholds are re-interpreted as attentional thresholds. Also, a cybernetics concept, the “Black Box”, is extended to infants, reinforcing the conclusions of the companion paper that the infant-as-research-subject cannot be conceptually separated from the attending laboratory staff. Indeed, infant and staff altogether constitute a new, reflexive whole, one that has proven too resilient for anybody’s good. (shrink)

The present study investigates the interaction between personal characteristics that are considered nowadays strengths used to face difficult events or transition period. A number of 200 married or living together participants completed self-reports for common goals, motivational persistence, resilience and well-being. Results show that persistence and resilience do interact with each other at an individual level but also from a family concept perspective. Moreover, maintaining apositive outlook and family spirituality do have an impact over the intensity and direction of the (...) relationship between long term purposes pursuing and recurrence of unattained purposes and changes in well-being registered in time. Resiliency as a personal characteristic and family resilience show good psychometric qualities for this study. Although some of the results are descriptive, in-depth analyses of direction and intensity of the relationships lead the finalconclusions to suggestions for further research and implications for psychological practice. (shrink)

Marriage is one of the most important topics in the education field since life in this world is structured by interaction among families and between families and other social institutions. Dissatisfaction and unsustainability of marriage have led the urgency of premarital education in various countries. The problem is that the spread of virtual reality has made marriage itself to become more complex and experience reinterpretation and reconfiguration, moreover with the emergence of new kind of marriage in the digital era, i.e. (...) virtual marriage. Everybody who has observed, known, or even tried, certainly asks the question, “Could (or: should) I accept virtual marriage?” . This study was aimed to investigate the role of tolerance of ambiguity and illusion of intimacy in online dating in predicting the acceptance of virtual marriage. There were 420 adolescents and young adults (212 males, 208 females; Mage=21.10 years old, SDage=1.459 years; 338 students, 82 employees or entrepreneurs) in the Greater Jakarta, Indonesia, participated in this study. It was found that the acceptance was not predicted by the ambiguity tolerance, but by the illusion of intimacy in online dating. The psychometric issues, substantive discussion, and recommendation are presented at the end of this article. The trend of virtual marriage should not be allowed to roll away, by autopilot, without loaded by strategies in designing an online game as one of the pivotal educational technologies that needs to shape appropriate character and attitude for it. (shrink)

Knowledge is power. Knowledge about human psychology is increasingly being produced using natural language processing (NLP) and related techniques. The power that accompanies and harnesses this knowledge should be subject to ethical controls and oversight. In this chapter, we address the ethical pitfalls that are likely to be encountered in the context of such research. These pitfalls occur at various stages of the NLP pipeline, including data acquisition, enrichment, analysis, storage, and sharing. We also address secondary uses of the results (...) and tools developed through psychometric NLP, such as profit-driven targeted advertising, political campaigns, and domestic and international psyops. Along the way, we reflect on potential ethical guidelines and considerations that may help researchers navigate these pitfalls. (shrink)

Any ethical inquiry into addiction research is faced with the preliminary challenge that the term “addiction” is itself a matter of scientific and ethical controversy. Accordingly, the chapter begins with a brief history of the term “addiction.” The chapter then turns to ethical issues surrounding consent and decision-making capacity viewed from the perspective of the current opioid epidemic. One concern is the neglect of the cyclical nature of addiction and the implications of this for the validity of current psychometric instruments (...) used to evaluate decision-making capacity in addiction. Another is the apparent discrepancy—possibly an ethical double standard—in the manner in which society and addiction researchers view the mental capacity and vulnerability of individuals who suffer from severe addiction. On the whole, the main ethical concern of the chapter is the puzzling lack of clinical research on decision-making capacity in research on addiction. (shrink)

Intellectual humility can be broadly construed as being conscious of the limits of one’s existing knowledge and capable to acquire more knowledge, which makes it a key virtue of the information age. However, the claim “I am (intellectually) humble” seems paradoxical in that someone who has the disposition in question would not typically volunteer it. There is an explanatory gap between the meaning of the sentence and the meaning the speaker ex- presses by uttering it. We therefore suggest analyzing intellectual (...) humility semantically, using a psycholexical approach that focuses on both synonyms and antonyms of ‘intellectual humili- ty’. We present a thesaurus-based methodology to map the semantic space of intellectual hu- mility and the vices it opposes as a heuristic to support philosophical and psychological anal- ysis of this disposition. We performed the mapping both in English and German in order to test for possible cultural differences in the understanding of intellectual humility. In both lan- guages, we find basically the same three semantic dimensions of intellectual humility (sensi- bility, discreetness, and knowledge dimensions) as well as three dimensions of its related vic- es (self-overrating, other-underrating and dogmatism dimensions). The resulting semantic clusters were validated in an empirical study with English (n=276) and German (n=406) par- ticipants. We find medium to high correlations (0.54-0.72) between thesaurus similarity and perceived similarity, and we can validate the labels of the three dimensions identified in the study. But we also find indications of the limitations of the thesaurus methodology in terms of cluster plausibility. We conclude by discussing the importance of these findings for construct- ing psychometric scales for intellectual humility. (shrink)

The issue of common method variance and bias in Indonesia still has not gained much attention; even the terminology is less popular, except among psychometric enthusiasts and experts. In fact, the potential for common method variance and bias infiltrating in research results is very high, especially in studies that use a single method, a single source, and concurrent design, which are highly favored by psychological lecturers and researchers in Indonesia. This paper is a critical review, exposing the debate and serious (...) impact regarding common method variance and bias, as well as procedures for detecting, addressing and correcting its effects. The author hoped this paper contributes in filling the gap in the literature, especially in Psychology Research Methodology text books in the Indonesian language, so that psychological researches in Indonesia continue to increase their quality and to have their better place in international publications. (shrink)

What is a valid measuring instrument? Recent philosophy has attended to logic of justification of measures, such as construct validation, but not to the question of what it means for an instrument to be a valid measure of a construct. A prominent approach grounds validity in the existence of a causal link between the attribute and its detectable manifestations. Some of its proponents claim that, therefore, validity does not depend on pragmatics and research context. In this paper, I cast doubt (...) on the possibility of a context-independent causal account of validity. I assess several versions, arguing that all of them fail to judge the validity of measuring instruments correctly. Because different research purposes require different properties from measuring instruments, no account of validity succeeds without referring to the specific research purpose that creates the need for measurement in the first place. (shrink)

Nowadays Fog Computing has become a vast research area in the domain of cloud computing. Due to its ability of extending the cloud services towards the edge of the network, reduced service latency and improved Quality of Services, which provides better user experience. However, the qualities of Fog Computing emerge new security and protection challenges. The Current security and protection estimations for cloud computing cannot be straightforwardly applied to the fog computing because of its portability and heterogeneity. So these issues (...) in fog computing arises new research challenges and opportunities. This survey features about existing security concerns for fog computing and new proposed system to tackle some of the issues in fog computing related to security and privacy, thereby enhancing the cloud security. (shrink)