Hostname: page-component-7b7567c8c-fvjsw Total loading time: 0 Render date: 2026-11-16T01:56:12.517Z Has data issue: false hasContentIssue false

A Systematic Study into the Factors that Affect the Predictive Accuracy of Multilevel VAR(1) Models

Published online by Cambridge University Press:  01 January 2025

Ginette Lafit*
Affiliation:
KU Leuven – University of Leuven
Kristof Meers
Affiliation:
KU Leuven – University of Leuven
Eva Ceulemans
Affiliation:
KU Leuven – University of Leuven
*
Correspondence should be made to Ginette Lafit, Research Group of Quantitative Psychology and Individual Differences, KU Leuven, Leuven, Belgium. Email: ginette.lafit@kuleuven.be

Abstract

The use of multilevel VAR(1) models to unravel within-individual process dynamics is gaining momentum in psychological research. These models accommodate the structure of intensive longitudinal datasets in which repeated measurements are nested within individuals. They estimate within-individual auto- and cross-regressive relationships while incorporating and using information about the distributions of these effects across individuals. An important quality feature of the obtained estimates pertains to how well they generalize to unseen data. Bulteel and colleagues (Psychol Methods 23(4):740–756, 2018a) showed that this feature can be assessed through a cross-validation approach, yielding a predictive accuracy measure. In this article, we follow up on their results, by performing three simulation studies that allow to systematically study five factors that likely affect the predictive accuracy of multilevel VAR(1) models: (i) the number of measurement occasions per person, (ii) the number of persons, (iii) the number of variables, (iv) the contemporaneous collinearity between the variables, and (v) the distributional shape of the individual differences in the VAR(1) parameters (i.e., normal versus multimodal distributions). Simulation results show that pooling information across individuals and using multilevel techniques prevent overfitting. Also, we show that when variables are expected to show strong contemporaneous correlations, performing multilevel VAR(1) in a reduced variable space can be useful. Furthermore, results reveal that multilevel VAR(1) models with random effects have a better predictive performance than person-specific VAR(1) models when the sample includes groups of individuals that share similar dynamics.

Information

Type
Theory and Methods
Copyright
Copyright © 2021 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable