| IOPS Course | The Use of Data in Decision-Making, Including Standardized Psychological Tests |
| Teachers | prof. dr. Marieke Timmerman and prof. dr. Rob Meijer, University of Groningen |
| Coordinator | Marieke Timmerman |
| Venue / Dates | University of Groningen (RUG) 26 & 27 November 2026 |
| Mandatory/Elective | Elective |
| ECTS | 2 |
| Registration | secretariaat@iops.nl The minimum number of participants is 10. Deadline registration: 20 October 2026 |
| Fee | IOPS-members: free |
| Abstract | Although the practice of psychological testing is firmly rooted in decision-making contexts -such as selection in the military and industry, and facilitating individual diagnosis and monitoring in clinical practice – test theory and psychometrics have evolved as a measurement science with little attention to how test scores are actually used in the decision procedures. Yet, when psychological test scores are used in decision-making, the human decision maker is back into the equation. Central in this course is the distinction between data collection and data combination. The first part of the course will be devoted to data that can be collected using standardized tests. Though most users take the nature of standardized test scores of a psychological test for granted, that very nature results from deliberate choices made by the test developer. To make well-judged interpretations of standardized test scores, it is key to understand their nature. We review the two types of standardized test score interpretations, namely the norm-referenced and criterion-referenced interpretations. We discuss when they are of use, how the construction process of the standardized test scores (‘norms’) is carried out ideally, and how these are reported ideally to test users. Using cases from empirical practice, we will devote attention to practical limitations and pitfalls that test developers may encounter. As currently many psychological tests are commercial products, we will also discuss the role of publishers in test development and maintenance. The second part of the course will be devoted to data combination. While collecting relevant information, like standardized test scores on relevant measurement instruments, is essential, most real-world decisions also require integrating multiple pieces of information. Herewith, decision makers often prefer intuitive, holistic approaches and -typically unintentionally-introduce bias and noise, thereby reducing the quality of their decisions. We review common flaws in holistic judgment and clarify how decision makers weigh information and how consistently they combine information. We discuss alternatives to holistic judgment that can improve decision quality while still satisfying basic human needs such as autonomy and relatedness. |
| Programme outline: | Thursday 26 November: 11:00-17:00 – Data from standardized psychological tests Friday 27 November: 9:00-15:00 – Decision making on Combinations of (Test) Data |
| Examination | (Small) assignment |
IOPS
