Hostname: page-component-7b7567c8c-lpg2g Total loading time: 0 Render date: 2026-11-15T18:09:53.916Z Has data issue: false hasContentIssue false

Ordinal Test Fidelity Estimated by an Item Sampling Model

Published online by Cambridge University Press:  01 January 2025

Norman Cliff*
Affiliation:
University of Southern California
John R. Donoghue
Affiliation:
Educational Testing Service
*
Requests for reprints should be sent to Norman Cliff, Department of Psychology, MC-1061, University of Southern California, Los Angeles, CA 90089.

Abstract

A test theory using only ordinal assumptions is presented. It is based on the idea that the test items are a sample from a universe of items. The sum across items of the ordinal relations for a pair of persons on the universe items is analogous to a true score. Using concepts from ordinal multiple regression, it is possible to estimate the tau correlations of test items with the universe order from the taus among the test items. These in turn permit the estimation of the tau of total score with the universe. It is also possible to estimate the odds that the direction of a given observed score difference is the same as that of the true score difference. The estimates of the correlations between items and universe and between total score and universe are found to agree well with the actual values in both real and artificial data.

Information

Type
Original Paper
Copyright
Copyright © 1992 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable