Hostname: page-component-7b7567c8c-wxvwp Total loading time: 0 Render date: 2026-11-16T03:59:54.179Z Has data issue: false hasContentIssue false

A Priori Reliability of Tests with Cut Score

Published online by Cambridge University Press:  01 January 2025

Guido Magnano*
Affiliation:
University of Turin
Chiara Tannoia
Affiliation:
University of Turin
Chiara Andrà
Affiliation:
University of Turin
*
Requests for reprints should be sent to Guido Magnano, Department of Mathematics, University of Turin, Via Carlo Alberto 10, 10123 Torino, Italy. E-mail: guido.magnano@unito.it

Abstract

The theoretical probability of misclassification in a mastery test is exactly computed using the raw score probability distribution (in the Rasch model) as a function of the examinee’s latent ability. The resulting misclassification probability curve, together with the latent ability distribution in the group of examinees, completely determines the expected rate of classification errors. It is shown that several distinct ability thresholds, playing different roles in connection to classification reliability, can be associated to a test with a single cut score. In particular, it is possible to define (and compute) two relevant ability intervals, which encapsulate the functioning of a mastery test (about and far from the cut score, respectively); the dependence of these intervals on the item difficulty spectrum is investigated. Extension to the 2PL model is also discussed, with emphasis on the effects of weighted scoring.

Information

Type
Original Paper
Copyright
Copyright © 2013 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable