Hostname: page-component-7b7567c8c-z4zkx Total loading time: 0 Render date: 2026-11-16T09:52:15.915Z Has data issue: false hasContentIssue false

Designing Learning Intervention Studies: Identifiability of Heterogeneous Hidden Markov Models

Published online by Cambridge University Press:  22 July 2025

Ying Liu
Affiliation:
Department of Statistics, University of Illinois Urbana-Champaign, Champaign, IL, USA
Steven Culpepper*
Affiliation:
Department of Statistics, University of Illinois Urbana-Champaign, Champaign, IL, USA
*
Corresponding author: Steven Culpepper; Email: sculpepp@illinois.edu
Rights & Permissions [Opens in a new window]

Abstract

Hidden Markov models (HMMs) are popular for modeling complex, longitudinal data. Existing identifiability theory for conventional HMMs assume emission probabilities are constant over time and the Markov chain governing transitions among the hidden states is irreducible, which are assumptions that may not be applicable in all educational and psychological research settings. We generalize existing conditions on homogeneous HMMs by considering heterogeneous HMMs with time-varying emission probabilities and the potential for absorbing states. Researchers are investigating a family of models known as restricted HMMs (RHMMs), which combine HMMs and restricted latent class models (RLCMs) to provide fine-grained classification of educationally and psychologically relevant attribute profiles over time. These RHMMs leverage the benefits of RLCMs and HMMs to understand changes in attribute profiles within longitudinal designs. The identifiability of RHMM parameters is a critical issue for ensuring successful applications and accurate statistical inference regarding factors that impact outcomes in intervention studies. We establish identifiability conditions for RHMMs. The new identifiability conditions for heterogeneous HMMs and RHMMs provide researchers insights for designing interventions. We discuss different types of assessment designs and the implications for practice. We present an application of a heterogeneous HMM to daily measures of positive and negative affect.

Information

Type
Theory and Methods
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - SA
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-ShareAlike licence (https://creativecommons.org/licenses/by-sa/4.0), which permits re-use, distribution, and reproduction in any medium, provided the same Creative Commons licence is used to distribute the re-used or adapted article and the original article is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of Psychometric Society
Figure 0

Figure 1First-order hidden Markov model (HMM) with latent $Z_t$ underlying the observed $Y_t$ variables.

Figure 1

Figure 2Flowchart of identifiability results for different types of hidden Markov models.Note: The boxes with dotted borders and italicized text indicate conditions from existing research whereas the bold boxes indicate conditions established in this paper.

Figure 2

Table 1Average MSE of the elements of $\boldsymbol {\Theta }$, $\mathbf {A}$, and $\boldsymbol {\pi }_1$ where MSE was computed from 500 replications

Figure 3

Figure 3Boxplots of simulated MSE for elements of the emission and transition matrices by sample size.

Figure 4

Figure 4Pie charts of item by class emission probabilities for the PANAS dataset.Note: The anchor labels were 1 = “not at all” and 5 = “extremely.”