A psychometric analysis of chess expertise

HAN L. J. VAN DER MAAS AND ERIC-JAN WAGENMAKERS
University of Amsterdam

This study introduces the Amsterdam Chess Test (ACT). The ACT measures chess playing proficiency through 5 tasks: a choose-a-move task (comprising two parallel tests), a motivation questionnaire, a predict-a-move task, a verbal knowledge questionnaire, and a recall task. The validity of these tasks was established using external criteria based on the Elo chess rating system. Results from a representative sample of active chess players showed that the ACT is a very reliable test for chess expertise and that ACT has high predictive validity. Several hypotheses about the relationships between chess expertise, chess knowledge, motivation, and memory were tested. Incorporating response latencies in test scores is shown to lead to an increase in criterion validity, particularly for easy items.