Hostname: page-component-7b7567c8c-tnzcf Total loading time: 0 Render date: 2026-11-14T13:30:03.255Z Has data issue: false hasContentIssue false
  • English
  • Français

Assessing Inter-Rater Reliability for Rating Scales: Resolving some Basic Issues

Published online by Cambridge University Press:  27 April 2018

Domenic V. Cicchetti
Domenic V. Cicchetti*
Affiliation:
V. A. Hospital, West Haven, Connecticut 06516; Associate Professor of Psychology, Department of Psychiatry, Yale University
Rights & Permissions [Opens in a new window]

Summary

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

This paper extends the recent work of Hall (1974) by presenting the minimal sample sizes and the specific linear agreement weights required for assessing the reliability of rating scales commonly used in neuropsychiatric and other clinico-medicai settings. The weights are shown to vary as a function of (a) whether or not the rating scale contains a point of ‘absence’, and (b) the number of ordinal points on the scale.

Information

Type
Papers
Information
The British Journal of Psychiatry , Volume 129 , Issue 5 , November 1976, pp. 452 - 456
Copyright
Copyright © Royal College of Psychiatrists, 1976 

References

Cicchetti, D. V. (1972) A new measure of agreement between rank ordered variables. Proceedings of the American Psychological Association, 7, 17–18.Google Scholar
Cicchetti, D. V. & Allison, T. (1973) Assessing the reliability of scoring EEG sleep records: an improved method. Proceedings and Journal of the Electro-physiological Technologists' Association, 20, 92–102.Google Scholar
Cicchetti, D. V., & Fleiss, J. L. (1975) A comparison of the null distributions of weighted kappa and the C ordinal statistic. Invited paper presented at the Joint Central Regional Meetings of the American Statistical Association, St Paul, Minnesota.Google Scholar
Cohen, J. (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213–20.CrossRefGoogle ScholarPubMed
Fleiss, J. L., Cohen, J. & Evfritt, B. S. (1969) Large sample standard errors of kappa and weighted kappa. Psychological Bulletin, 72, 323–7.Google Scholar
Hall, J. N. (1974) Inter-rater reliability of ward rating scales. British Journal of Psychiatry, 125, 248–55.Google Scholar
Lorr, M., Klett, J., McNair, D. M. & Lasky, J. J. (1962) Inpatient Multidimensional Psychiatric Scale (IMPS). Palo Alto: Consulting Psychologists Press.Google Scholar
Overall, J. E. & Gorham, D. R. (1962) The brief psychiatric rating scale. Psychological Reports, 10, 799–812.CrossRefGoogle Scholar
Overall, J. E. & Klett, C. J. (1972) Applied Multivariate Analysis. New York: McGraw-Hill (Introductory chapar).Google Scholar

This journal is not currently accepting new eletters.

eLetters

No eLetters have been published for this article.