Project
Effectiveness of Self-Correction Mechanisms in Psychological Research

Despite self-correction being vital for scientific progress, Psychology faces challenges in implementing corrective practices (Wiggins & Christopherson, 2019). This project examines the effectiveness of self-corrective mechanisms by looking at engagement with these mechanisms within psychological research. The project focuses on mechanisms available to individual scholars and explores researchers’ beliefs and behaviours in relation to corrective methods. Specifically, given the tension between increased benefits and costs, we propose focusing on adversarial collaborations for Studies 1 and 2. Adversarial collaborations are studies which use a structured collaboration between theoretical opponents to conduct rigorous, transparent research that aims to resolve the theoretical controversies (Ceci et al., 2024; Vlasceanu et al., 2022). Study 1 employs an experimental design to estimate the perceived evidentiary value (i.e., credibility, methodological quality) of such collaborations compared to regular studies.  Complementary, Study 2 analyses citation patterns and sentiment toward adversarial collaborations to assess their impact on the literature. In such, both studies build upon findings that suggest how replication research is evaluated differently from regular research (e.g., (Hardwicke et al., 2021; Hendriks et al., 2020; Serra-Garcia & Gneezy, 2021; Van Den Akker et al., 2023). In Study 3, we will zoom out, reviewing the effectiveness of specific correction mechanisms. Whereas specific content will be determined later, we suggest focusing on replications. Study 4 will develop and execute a follow-up investigation based on gaps identified. In short, this project will combine a range of methodologies and aims to develop an understanding of which corrective mechanisms are effective and recommended given specific circumstances. This diversity in methodological approaches and comparison of research methods makes the project a good fit for the IOPS graduate school. The active focus on self- correction has the potential to improve psychological research. Beyond this, I also hope to be inspired by other IOPS members and look forward to taking the courses offered. I believe my IOPS membership will improve the quality of my research and will bridge meta-science and methodological knowledge.

Supervisors
Prof. Dr. Elise Dusseldorp
Dr. Tom Heyman
Dr. Anna van ‘t Veer

Financed by
Internal funding Leiden University

Period
6 January 2025 – 6 January 2030