Pownall, Madeleine, Pennington, Charlotte R., Norris, Emma, Juanchich, Marie, Smailes, David, Russell, Sophie, Gooch, Debbie, Evans, Thomas Rhys ORCID: 0000-0002-6670-0718 , Persson, Sofia, Mak, Matthew H. C., Tzavella, Loukia, Monk, Rebecca, Gough, Thomas, Benwell, Christopher S. Y., Elsherif, Mahmoud, Farran, Emily, Gallagher-Mitchell, Thomas, Kendrick, Luke T., Bahnmueller, Julia, Nordmann, Emily, Zaneva, Mirela, Gilligan-Lee, Katie, Bazhydai, Marina, Jones, Andrew, Sedgmond, Jemma, Holzleitner, Iris, Reynolds, James, Moss, Jo, Farrelly, Daniel, Parker, Adam J. and Clark, Kait (2023) Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: a registered report. Advances in Methods and Practices in Psychological Science, 6 (4). pp. 1-21. ISSN 2515-2459 (Online) (doi:https://doi.org/10.1177/25152459231202724)

Preview	PDF (Open Access Article) 44178_EVANS_Evaluating_the_pedagogical_effectiveness_of_study_preregistration_in_the undergraduate_dissertation_(OA)_2023.pdf - Published Version Available under License Creative Commons Attribution Non-commercial. Download (573kB) | Preview
Preview	PDF (AAM) 44178_EVANS_Evaluating_the_pedagogical_effectiveness_of_study_preregistration_in_the undergraduate_dissertation.pdf - Accepted Version Available under License Creative Commons Attribution Non-commercial. Download (466kB) | Preview

Abstract

Research shows that questionable research practices (QRPs) are present in undergraduate final year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is ‘study preregistration’, through which researchers outline their research questions, design, method and analysis plans prior to data collection and/or analysis. In this study, we aimed to empirically test the effectiveness of preregistration as a pedagogic tool in undergraduate dissertations using a quasi-experimental design. A total of 89 UK psychology students were recruited, including students who preregistered their empirical quantitative dissertation (n = 52; experimental group) and those who did not (n = 37; control group). Attitudes towards statistics, acceptance of QRPs, and perceived understanding of Open Science were measured both pre- and post-dissertation. Exploratory measures included capability, opportunity and motivation (COM-B) to engage with preregistration, measured at Time 1 only. This study was conducted as a Registered Report; Stage 1 protocol: https://osf.io/9hjbw (date of in-principle acceptance: 21/09/2021). Contrary to hypotheses, study preregistration did not significantly impact attitudes towards statistics or acceptance of QRPs. However, students who preregistered reported greater perceived understanding of Open Science concepts from Time 1 to Time 2, compared with students who did not preregister. Exploratory analyses indicated that students who preregistered reported significantly greater capability, opportunity, and motivation to preregister. Qualitative responses revealed that preregistration was perceived to improve clarity and organisation of the dissertation, prevent QRPs, and promote rigour. Disadvantages and barriers included time, perceived rigidity, and need for training. These results contribute to timely discussions surrounding the utility of embedding Open Science principles into research training.

Item Type:	Article
Uncontrolled Keywords:	preregistration; Open Science; reproducibility; undergraduate training; dissertations; research training
Subjects:	L Education > L Education (General) L Education > LB Theory and practice of education L Education > LB Theory and practice of education > LB2300 Higher Education
Faculty / School / Research Centre / Research Group:	Faculty of Education, Health & Human Sciences Faculty of Education, Health & Human Sciences > School of Human Sciences (HUM)
Last Modified:	09 Jan 2024 12:55
URI:	http://gala.gre.ac.uk/id/eprint/44178

Actions (login required)

View Item

Downloads