Hostname: page-component-7b7567c8c-wxvwp Total loading time: 0 Render date: 2026-11-16T15:47:04.190Z Has data issue: false hasContentIssue false

Paradoxical Results in Multidimensional Item Response Theory

Published online by Cambridge University Press:  01 January 2025

Giles Hooker*
Affiliation:
Cornell University
Matthew Finkelman
Affiliation:
Tufts University School of Dental Medicine
Armin Schwartzman
Affiliation:
Harvard School of Public Health
*
Requests for reprints should be sent to Giles Hooker, Cornell University, Ithaca, NY 14853, USA. E-mail: giles.hooker@cornell.edu

Abstract

In multidimensional item response theory (MIRT), it is possible for the estimate of a subject’s ability in some dimension to decrease after they have answered a question correctly. This paper investigates how and when this type of paradoxical result can occur. We demonstrate that many response models and statistical estimates can produce paradoxical results and that in the popular class of linearly compensatory models, maximum likelihood estimates are guaranteed to do so. In light of these findings, the appropriateness of multidimensional item response methods for assigning scores in high-stakes testing is called into question.

Information

Type
Theory and Methods
Copyright
Copyright © 2009 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable