Hostname: page-component-7b7567c8c-tnkh4 Total loading time: 0 Render date: 2026-11-16T06:28:36.797Z Has data issue: false hasContentIssue false

Measuring Nominal Scale Agreement Between a Judge and a Known Standard

Published online by Cambridge University Press:  01 January 2025

D. D. Wackerly*
Affiliation:
University of Florida
J. T. McClave
Affiliation:
University of Florida
P. V. Rao
Affiliation:
University of Florida
*
Requests for reprints should be sent to D. D. Wackerly, Department of Statistics, Nuclear Sciences Center, University of Florida, Gainesville, Florida 32611.

Abstract

Two designs for comparing a judge's ratings with a known standard are presented and compared. Design A pertains to the situation where the judge is asked to categorize each of N subjects into one of r (known) classes with no knowledge of the actual number in each class. Design B is employed when the judge is given the actual number in each class and is asked to categorize the individuals subject to these constraints. The probability distribution of the total number of correct choices is developed in each case. A power comparison of the two procedures is undertaken.

Information

Type
Original Paper
Copyright
Copyright © 1978 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable