Hostname: page-component-7b7567c8c-fvjsw Total loading time: 0 Render date: 2026-11-14T19:41:49.488Z Has data issue: false hasContentIssue false

Hypergeometric Family and Item Overlap Rates in Computerized Adaptive Testing

Published online by Cambridge University Press:  01 January 2025

Hua-Hua Chang
Affiliation:
University of Texas at Austin
Jinming Zhang*
Affiliation:
Educational Testing Service
*
Requests for reprints should be sent to Jinming Zhang, MS 02-T, Educational Testing Service, Princeton, NJ 08541. E-Mail: jmzhang@ets.org

Abstract

A computerized adaptive test (CAT) is usually administered to small groups of examinees at frequent time intervals. It is often the case that examinees who take the test earlier share information with examinees who will take the test later, thus increasing the risk that many items may become known. Item overlap rate for a group of examinees refers to the number of overlapping items encountered by these examinees divided by the test length. For a specific item pool, different item selection algorithms may yield different item overlap rates. An important issue in designing a good CAT item selection algorithm is to keep item overlap rate below a preset level. In doing so, it is important to investigate what the lowest rate could be for all possible item selection algorithms. In this paper we rigorously prove that if every item has an equal possibility to be selected from the pool in a fixed-length CAT, the number of overlapping items among any α randomly sampled examinees follows the hypergeometric distribution family for α ≥ 1. Thus, the expected values of the number of overlapping items among any randomly sampled α examinees can be calculated precisely. These values may serve as benchmarks in controlling item overlap rates for fixed-length adaptive tests.

Information

Type
Articles
Copyright
Copyright © 2002 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable