Hostname: page-component-7b7567c8c-8tzhz Total loading time: 0 Render date: 2026-11-19T11:44:06.784Z Has data issue: false hasContentIssue false

To Weight or Not to Weight? Balancing Influence of Initial Items in Adaptive Testing

Published online by Cambridge University Press:  01 January 2025

Hua-Hua Chang*
Affiliation:
University of Illinois
Zhiliang Ying
Affiliation:
Columbia University
*
Requests for reprints should be sent to Hua-Hua Chang, University of Illinois, Urbana, USA. E-mail: hhchang@uiuc.edu

Abstract

It has been widely reported that in computerized adaptive testing some examinees may get much lower scores than they would normally if an alternative paper-and-pencil version were given. The main purpose of this investigation is to quantitatively reveal the cause for the underestimation phenomenon. The logistic models, including the 1PL, 2PL, and 3PL models, are used to demonstrate our assertions. Our analytical derivation shows that, under the maximum information item selection strategy, if an examinee failed a few items at the beginning of the test, easy but more discriminating items are likely to be administered. Such items are ineffective to move the estimate close to the true θ, unless the test is sufficiently long or a variable-length test is used. Our results also indicate that a certain weighting mechanism is necessary to make the algorithm rely less on the items administered at the beginning of the test.

Information

Type
Theory and Methods
Copyright
Copyright © 2007 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable