Skip navigation

Quantitative psychology under scrutiny: Measurement requires not result-dependent but traceable data generation

Quantitative psychology under scrutiny: Measurement requires not result-dependent but traceable data generation

Uher, Jana ORCID: 0000-0003-2450-4943 (2020) Quantitative psychology under scrutiny: Measurement requires not result-dependent but traceable data generation. Personality and Individual Differences, 170:110205. ISSN 0191-8869 (doi:https://doi.org/10.1016/j.paid.2020.110205)

[img] PDF (Author Accepted Manuscript)
30460 UHER_Quantitative_Psychology_under_Scrutiny_(AAM)_2020.pdf - Accepted Version
Restricted to Registered users only until 10 October 2022.
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (472kB) | Request a copy

Abstract

Various lines of critique of quantitative psychology, well-established and new, are used to trace along the field's typical steps of research a complex network of misconceptions and fallacies codified in psychological jargon. The article explores what constructs actually are, why they are needed in psychology, fallacies and challenges in construct research, and the crucial role of language. It shows how common misconceptions of language and concepts mislead psychologists to conflate phenomena, qualities, quantities and constructs with one another and with their semiotic encodings in terms, variables and scores. The article clarifies the conceptual relations between nomological networks, representation theorems and psychometric modelling. It reveals conflations of disparate notions of causality and unobservability, and erroneous equations of nomological networks with semantic networks, description with explanation, and measurement theories with explanatory theories. Instead of establishing causal measurand-result relations, common practices match data generation to the results rather than the phenomena and properties studied. Mathematical meaning for scores is often created from differences between individuals and between different phenomena and properties, which constitute mere conceptual entities and cannot reflect magnitudes attributable to individuals. This entails biased inferences on the actual study phenomena and shows that replicability problems may be even larger than assumed.

Item Type: Article
Uncontrolled Keywords: measurement, assessment, psychometrics, replicability, test interpretation, test scores, validity, instrument development
Subjects: B Philosophy. Psychology. Religion > BF Psychology
Faculty / Department / Research Group: Faculty of Education, Health & Human Sciences
Faculty of Education, Health & Human Sciences > Department of Psychology, Social Work & Counselling
Related URLs:
Last Modified: 25 Jan 2021 22:15
Selected for GREAT 2016: None
Selected for GREAT 2017: None
Selected for GREAT 2018: None
Selected for GREAT 2019: None
Selected for REF2021: None
URI: http://gala.gre.ac.uk/id/eprint/30460

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics