Hostname: page-component-7b7567c8c-fvjsw Total loading time: 0 Render date: 2026-11-16T21:14:52.881Z Has data issue: false hasContentIssue false

The UMP Exact Test and the Confidence Interval for Person Parameters in IRT Models

Published online by Cambridge University Press:  01 January 2025

Xiang Liu*
Affiliation:
Teachers College of Columbia University
Zhuangzhuang Han
Affiliation:
Teachers College of Columbia University
Matthew S. Johnson
Affiliation:
Teachers College of Columbia University
*
Correspondence should be made to Xiang Liu, Department of Human Development, Teachers College of Columbia University, 525 West 120th Street, New York, NY 10027-6696, USA. Email: xl2438@tc.columbia.edu

Abstract

In educational and psychological measurement when short test forms are used, the asymptotic normality of the maximum likelihood estimator of the person parameter of item response models does not hold. As a result, hypothesis tests or confidence intervals of the person parameter based on the normal distribution are likely to be problematic. Inferences based on the exact distribution, on the other hand, do not suffer from this limitation. However, the computation involved for the exact distribution approach is often prohibitively expensive. In this paper, we propose a general framework for constructing hypothesis tests and confidence intervals for IRT models within the exponential family based on exact distribution. In addition, an efficient branch and bound algorithm for calculating the exact p value is introduced. The type-I error rate and statistical power of the proposed exact test as well as the coverage rate and the lengths of the associated confidence interval are examined through a simulation. We also demonstrate its practical use by analyzing three real data sets.

Information

Type
Original Paper
Copyright
Copyright © 2017 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable