Skip navigation

Quantitative psychology under scrutiny: Measurement requires not result-dependent but traceable data generation

Quantitative psychology under scrutiny: Measurement requires not result-dependent but traceable data generation

Uher, Jana ORCID logoORCID: https://orcid.org/0000-0003-2450-4943 (2020) Quantitative psychology under scrutiny: Measurement requires not result-dependent but traceable data generation. Personality and Individual Differences, 170:110205. ISSN 0191-8869 (doi:10.1016/j.paid.2020.110205)

[thumbnail of Author Accepted Manuscript]
Preview
PDF (Author Accepted Manuscript)
30460 UHER_Quantitative_Psychology_under_Scrutiny_(AAM)_2020.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (472kB) | Preview

Abstract

Various lines of critique of quantitative psychology, well-established and new, are used to trace along the field's typical steps of research a complex network of misconceptions and fallacies codified in psychological jargon. The article explores what constructs actually are, why they are needed in psychology, fallacies and challenges in construct research, and the crucial role of language. It shows how common misconceptions of language and concepts mislead psychologists to conflate phenomena, qualities, quantities and constructs with one another and with their semiotic encodings in terms, variables and scores. The article clarifies the conceptual relations between nomological networks, representation theorems and psychometric modelling. It reveals conflations of disparate notions of causality and unobservability, and erroneous equations of nomological networks with semantic networks, description with explanation, and measurement theories with explanatory theories. Instead of establishing causal measurand-result relations, common practices match data generation to the results rather than the phenomena and properties studied. Mathematical meaning for scores is often created from differences between individuals and between different phenomena and properties, which constitute mere conceptual entities and cannot reflect magnitudes attributable to individuals. This entails biased inferences on the actual study phenomena and shows that replicability problems may be even larger than assumed.

Item Type: Article
Uncontrolled Keywords: measurement, assessment, psychometrics, replicability, test interpretation, test scores, validity, instrument development
Subjects: B Philosophy. Psychology. Religion > BF Psychology
Faculty / School / Research Centre / Research Group: Faculty of Education, Health & Human Sciences
Faculty of Education, Health & Human Sciences > School of Human Sciences (HUM)
Related URLs:
Last Modified: 10 Oct 2022 01:38
URI: http://gala.gre.ac.uk/id/eprint/30460

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics