Hostname: page-component-74656f9884-54qdv Total loading time: 0 Render date: 2026-11-10T03:34:46.625Z Has data issue: false hasContentIssue false
  • English
  • Français

Multilevel Model Prediction

Published online by Cambridge University Press:  01 January 2025

Edward W. Frees  and
Jee-Seon Kim
Edward W. Frees
Affiliation:
University of Wisconsin, Madison
Jee-Seon Kim*
Affiliation:
University of Wisconsin, Madison
*
Requests for reprints should be sent to Jee-Seon Kim, Department of Educational Psychology, University of Wisconsin, 1025 West Johnson Street, Madison, WI 53706, USA. E-mail: jeeseonkim@wisc.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Multilevel models are proven tools in social research for modeling complex, hierarchical systems. In multilevel modeling, statistical inference is based largely on quantification of random variables. This paper distinguishes among three types of random variables in multilevel modeling—model disturbances, random coefficients, and future response outcomes—and provides a unified procedure for predicting them. These predictors are best linear unbiased and are commonly known via the acronym BLUP; they are optimal in the sense of minimizing mean square error and are Bayesian under a diffuse prior.

For parameter estimation purposes, a multilevel model can be written as a linear mixed-effects model. In this way, parameters of the many equations can be estimated simultaneously and hence efficiently. For prediction purposes, we show that it is more convenient to retain the multiple equation feature of multilevel models. In this way, the efficient BLUPs are easy to compute and retain their intuitively appealing recursive form. We also derive explicit equations for standard errors of these different types of predictors.

Prediction in multilevel modeling is important in a wide range of applications. To demonstrate the applicability of our results, this paper discusses prediction in the context of a study of school effectiveness.

Keywords

best linear unbiased predictorslinear mixed-effects modelshierarchical linear modelsrandom coefficientsschool effectiveness

Information

Type
Original Paper
Information
Psychometrika , Volume 71 , Issue 1 , March 2006 , pp. 79 - 104
Copyright
Copyright © 2006 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

This research was supported by a grant from the Graduate School at the University of Wisconsin at Madision and the National Science Foundation, Grant number SES-0436274. We are grateful to Norman Webb at Wisconsin Center for Education Research for making available the data used in the reported application.

References

Aitkin, M., & Longford, N. (1986). Statistical modelling in school effectiveness (with Discussion). Journal of the Royal Statistical Society, Series A, 149, 1–43.10.2307/2981882CrossRefGoogle Scholar
Bickel, P.J., & Doksum, K.A. (1977). Mathematical statistics: Basic ideas and selected topics, San Francisco, CA: Holden-Day.Google Scholar
Browne, W.J., & Draper, D. (2000). Implementation and performance issues in the Bayesian fitting of multilevel models. Computational Statistics, 15, 391–420.CrossRefGoogle Scholar
Browne, W.J., & Draper, D. (2004). A comparison of Bayesian and likelihood-based methods for fitting multilevel models. Unpublished manuscript available at: http://multilevel.ioe.ac.uk/team/bill.html.Google Scholar
Carroll, R.J., & Ruppert, D. (1988). Transformation and weighting in regression, New York: Chapman & Hall.10.1007/978-1-4899-2873-3CrossRefGoogle Scholar
Dunn, M.C., Kadane, J.B., & Garrow, J.R. (2003). Comparing harm done by mobility and class absence: Missing students and missing data. Journal of Educational and Behavioral Statistics, 28, 269–288.10.3102/10769986028003269CrossRefGoogle Scholar
Frees, E.W. (2004). Longitudinal and panel data: Analysis and applications for the social sciences, Cambridge: Cambridge University Press.10.1017/CBO9780511790928CrossRefGoogle Scholar
Frees, E.W., & Miller, T.W. (2004). Sales forecasting using longitudinal data models. International Journal of Forecasting, 20, 97–111.10.1016/S0169-2070(03)00005-0CrossRefGoogle Scholar
Frees, E.W., Young, V., & Luo, Y. (1999). A longitudinal data analysis interpretation of credibility models. Insurance: Mathematics and Economics, 24, 229–247.Google Scholar
Gelfand, A.E., Carlin, B.P., & Trevisani, M. (2001). On computation using Gibbs sampling for multilevel models. Statistica Sinica, 11, 981–1003.Google Scholar
Gelman, A., Carlin, J.B., Stern, H.S., & Rubin, D.B. (2004). Bayesian data analysis, London: Chapman & Hall.Google Scholar
Goldberger, A.S. (1962). Best linear unbiased prediction in the generalized linear regression model. Journal of American Statistical Association, 57, 369–375.10.1080/01621459.1962.10480665CrossRefGoogle Scholar
Goldstein, H. (1997). Methods in school effectiveness research. School Effectiveness and School Improvement, 8, 369–395.10.1080/0924345970080401CrossRefGoogle Scholar
Goldstein, H. (2003). Multilevel statistical models, (3rd ed.). London: Oxford University Press.Google Scholar
Goldstein, H., Browne, W., & Rasbash, J. (2002). Tutorial in biostatistics: Multilevel modeling of medical data. Statistics in Medicine, 21, 3291–3315.10.1002/sim.1264CrossRefGoogle Scholar
Goldstein, H., & Healy, M.J.R. (1995). The graphical presentation of a collection of means. Journal of the Royal Statistical Society, Series A, 158, 175–177.10.2307/2983411CrossRefGoogle Scholar
Goldstein, H., Rasbash, J., Yang, M., Woodhouse, G., Pan, H., Nuttall, D.L., & Thomas, S. (1993). A multilevel analysis of school examination results. Oxford Review of Education, 19, 425–433.10.1080/0305498930190401CrossRefGoogle Scholar
Goldstein, H., & Woodhouse, G. (2000). School effectiveness research and educational policy. Oxford Review of Education, 26, 353–363.10.1080/713688547CrossRefGoogle Scholar
Greenland, S. (2000). Principles of multilevel modeling. International Journal of Epidemiology, 29, 158–167.10.1093/ije/29.1.158CrossRefGoogle Scholar
Harville, D.A. (1976). Extension of the Gauss—Markov theorem to include the estimation of random effects. The Annals of Statistics, 4, 384–395.10.1214/aos/1176343414CrossRefGoogle Scholar
Holland, P.W., & Hoskens, M. (2003). Classical test theory as a first-order item response theory: Application to true-score prediction from a possibly nonparallel test. Psychometrika, 68, 123–149.CrossRefGoogle Scholar
Kackar, R.N., & Harville, D. (1984). Approximations for standard errors of estimators of fixed and random effects in mixed linear models. Journal of the American Statistical Association, 79, 853–862.Google Scholar
Kenward, M.G., & Roger, J.H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53, 983–997.10.2307/2533558CrossRefGoogle ScholarPubMed
Longford, N.T. (1993). Random coefficient models, New York: Oxford University Press.Google Scholar
McCulloch, C.E., & Searle, S.R. (2001). Generalized, linear, and mixed models, New York: Wiley.Google Scholar
Pinheiro, J.C., & Bates, D.M. (2000). Mixed-effects models in S and S-plus, New York: Springer-Verlag.10.1007/978-1-4419-0318-1CrossRefGoogle Scholar
Raudenbush, S.W., & Bryk, A.S. (2002). Hierarchical linear models: Applications and data analysis methods, (2nd ed.). Newbury Park, CA: Sage.Google Scholar
Raudenbush, S.W., & Willms, J.D. (1995). The estimation of school effects. Journal of Educational and Behavioral Statistics, 20, 307–335.CrossRefGoogle Scholar
Robinson, G. K. (1991). The estimation of random effects. Statistical Sciences, 6, 15–51.10.1214/ss/1177011926CrossRefGoogle Scholar
Singer, J. (1998). Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. Journal of Educational and Behavioral Statistics, 24, 323–355.10.3102/10769986023004323CrossRefGoogle Scholar
Snijders, T.A.B., & Bosker, R.J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling, London: Sage.Google Scholar
Steenbergen, M.R., & Jones, B.S. (2002). Modeling multilevel data structures. American Journal of Political Science, 46, 218–237.10.2307/3088424CrossRefGoogle Scholar
Texas Educational Agency, National Computer Systems Pearson, Harcourt Educational Measurement, & BETA, Inc. (2002). Texas student assessment program: Technical digest for the academic year 2000–2001. Austin, TX. Internet: http://www.tea.state.tx.us/student.assessment/resources/techdig02/index.html.Google Scholar
Webb, N.L., Clune, W.H., Bolt, D.M., Gamoran, A., Meyer, R.H., Osthoff, E., & Thorn, C. (2002). Models for analysis of NSF’s systemic initiative programs—The impact of the urban system initiatives on student achievement in Texas, 1994–2000. Wisconsin Center for Education Research Technical Report. Madison, WI.Google Scholar