To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
This study proposes a copula-based model that relaxes the multivariate normality assumption among latent traits in the joint modeling of multimodal data, such as item response and response times. In the structural model, the joint distribution of latent traits is defined via a copula with tail dependence. An expectation–maximization algorithm with stochastic approximation is implemented for parameter estimation. A simulation study evaluates the proposed method’s accuracy in ability estimation under various conditions, comparing it to traditional approaches. By better capturing the dependence structure between latent ability and speed, the proposed method outperforms the traditional approach with multivariate normality assumption. Applied to a variety of empirical datasets, the proposed method’s flexibility and the improvement in model fit are illustrated. The copula-based latent variable modeling can be generalized to broader applications in psychological testing involving multivariate latent traits.
Pfadt et al. present accessible methods for estimating conditional standard errors of measurement (CSEMs) and implement them in the open-source software JASP. Their emphasis on individual-level precision represents an important contribution to applied measurement practice. This commentary discusses several conceptual issues that clarify and extend the authors’ treatment of dimensionality, error definition, and score interpretation. The aim is to strengthen alignment between CSEM estimation and the interpretive purposes for which test scores are used.
Emotion dysregulation is a transdiagnostic construct associated with multiple mental health conditions and shown to be an amenable target for treatment. The original Emotion Dysregulation Inventory (EDI) was created as a proxy-report measure validated in autistic and nonautistic youth. The goal of the current study was to develop a self-report version, the EDI-Self-Report (EDI-SR), that captures a first-person perspective and creates the option of multi-reporter measurement from adolescence through adulthood.
Methods
Using methods developed by the Patient-Reported Outcomes Measurement Information System (PROMIS), potential items and response options were written and tested in cognitive interviews. Two samples (996 participants who are autistic or have other intellectual and developmental disabilities and 1,000 participants selected to be representative of the US census as a nonclinical comparison group) completed the initial item pool. Items were assessed using exploratory and confirmatory factor analyses, item response theory analyses, concurrent calibrations, convergent correlations with comparable legacy measures, internal consistency reliability, and test–retest reliability.
Results
Exploratory factor analyses suggested splitting Reactivity and Dysphoria items for confirmatory factor analyses and subsequent analyses. Following analyses, a 25-item Reactivity scale, a 7-item Dysphoria scale, and a 6-item Reactivity short-form scale were finalized. EDI-SR subscales showed convergent validity and superior total information when compared with similar measures, strong internal consistency reliability, and good test–retest reliability.
Conclusions
The EDI-SR provides an efficient, precise measure of ED in autistic individuals, individuals with other intellectual and developmental disabilities, and a US census-matched representative sample, and allows for multi-reporter assessment in clinical and research contexts.
We propose a latent trait model for the responses and response times on tests that separates capability from persistence. Core of the model is a race between a diffusion process and a censoring process. The diffusion process represents item-level cognitive processing and determines the processing time of a test taker. The censoring process sets the maximal time a test taker is willing to invest into an item. If the processing time is shorter than the maximal time, the response is generated by the diffusion process; otherwise, the response is generated differently. In the first version of the model, the response is generated by a random guess. In the second version of the model, the response is determined by the actual level of the diffusion process. We relate the diffusion process to the capability and response caution of a test taker and the censoring process to his willingness to invest time. Similar to models for rapid guessing, the proposed models take account of disengaged responding, but allow for individual differences in persistence and informed guessing. The model also provides a mathematical specification of persistence. In a simulation study, we investigate model fitting by marginal maximum likelihood estimation. We also apply the model to two empirical data sets.
The main focus of this chapter is on evaluating the reliability and validity of the PCL:YV among a cohort of 535 youth from the ISVYOS. Reliability indicators included internal reliability and interrater reliability. Overall, there was strong support for the reliability of the PCL:YV among ISVYOS participants. Validity indicators included construct validity and convergent validity. In terms of construct validity, in line with prior research, a series of confirmatory factor analyses found support for both a hierarchical three-factor model (i.e., Interpersonal, Affective, and Lifestyle Factors). Although there was also support for a four-factor model that includes an Antisocial factor, this model did not offer an improvement over a three-factor model. Item response theory and psychopathology network modeling identified interpersonal and affective traits as most prototypical of the overarching psychopathy construct (e.g., impression management, grandiosity, pathological lying, manipulation, lack of remorse, shallow affect, callous/lack of empathy, failure to accept responsibility). In terms of convergent validity, only moderate overlap was observed between the PCL:YV and two other measures of psychopathy.
Violations of the assumption of local independence are a fundamental issue in item response theory as they threaten model validity and bias the parameter estimates. For such a reason, a plethora of tests and approaches has been devised in the last 40 years to detect or to model such violations. Nonetheless, local dependence (LD) remains an open problem, with somewhat blurred boundaries due to the lack of a general framework for dealing with the different notions of dependence that have been suggested in the literature. The present contribution has a two-fold aim: On the one hand, to review and collect some of the approaches available in the literature; on the other hand, by following a unified perspective on assessment models introduced by Noventa et al. (2024, Journal of Mathematical Psychology 122, 102872) to suggest a possible systematization of some existing and some new approaches to LD. As a result, deterministic and probabilistic modeling mechanisms of LD are formalized and discussed.
ShinyItemAnalysis (SIA) is an R package and shiny application for an interactive presentation of psychometric methods and analysis of multi-item measurements in psychology, education, and social sciences in general. In this article, we present a new feature introduced in the recent version of the package, called “SIA modules,” which allows researchers and practitioners to offer new analytical methods for broader use via add-on extensions. SIA modules are designed to integrate with and build upon the SIA interactive application, enabling them to leverage the existing infrastructure for tasks, such as data uploading and processing. They can access and further use a range of outputs from various analyses, including models and datasets. Because SIA modules come in R packages (or extend existing ones), they can be bundled with their datasets, utilize object-oriented systems, or even compiled code. We illustrate the concepts using sample modules from the newly introduced SIAmodules package and other packages. After providing a general overview of building Shiny applications, we describe how to develop the SIA add-on modules with the support of the new SIAtools package. Finally, we discuss the possibilities of future development and emphasize the importance of freely available, interactive psychometric software for disseminating methodological innovations.
In latent space item response models (LSIRMs), subjects and items are embedded in a low-dimensional Euclidean latent space. As such, interactions among persons and/or items can be revealed that are unmodeled in conventional item response theory models. Current estimation approach for LSIRMs is a fully Bayesian procedure with Markov Chain Monte Carlo, which is, while practical, computationally challenging, hampering applied researchers to use the models in a wide range of settings. Therefore, we propose an LSIRM based on two variants of regularized joint maximum likelihood (JML) estimation: penalized JML and constrained JML. Owing to the absence of integrals in the likelihood, the JML methods allow for various models to be fit in limited amount of time. This computational speed facilitates a practical extension of LSIRMs to ordinal data, and the possibility to select the dimensionality of the latent space using cross-validation. In this study, we derive the two JML approaches and address different issues that arise when using maximum likelihood to estimate the LSIRM. We present a simulation study demonstrating acceptable parameter recovery and adequate performance of the cross-validation procedure. In addition, we estimate different binary and ordinal LSIRMs on real datasets pertaining to deductive reasoning and personality. All methods are implemented in R package ‘LSMjml’ which is available from CRAN.
The article proposes a new approach to estimating the latent distribution of item response theory (IRT) using kernel density estimation (KDE), particularly the solve-the-equation (STE) algorithm developed by Sheather and Jones (1991). As with existing methods, the KDE method aims to estimate the latent distribution of IRT to reduce biases in parameter estimates when the normality assumption on the latent variable is violated. Simulation studies and an empirical example confirm the robustness of algorithmic convergence of the KDE approach, and show that the KDE approach yields parameter estimates that are more accurate than or comparable to existing methods. Unlike other approaches that require multiple model fits for smoothing parameter selection, KDE requires only a single model-fitting step, substantially reducing computation time. These findings highlight KDE as a practical and efficient method for estimating latent distributions in IRT.
Traditional large-scale educational data are typically static and updated periodically, making it difficult to capture the dynamic changes in real time. However, recent technological advancements allow online exam platforms to collect students’ response data in real time. While item response theory (IRT) estimation methods are widely recognized for their accuracy, they are primarily designed for offline environments. When real-time data continuously arrives and online parameter estimation is required, these methods become computationally impractical. To address this challenge, we propose a recursive stochastic algorithm, i.e., truncated average stochastic Newton algorithm (TASNA), for the efficient online parameter estimation within the IRT framework. This algorithm significantly improves computational efficiency compared to the expectation–maximization (EM) algorithm implemented in the mirt package in R. The algorithm offers a powerful alternative to the traditional offline EM method. Furthermore, we investigate the asymptotic properties of the algorithm, proving its almost sure convergence and asymptotic normality. Numerical experiments using both simulated and real data demonstrate the practicality of the proposed method.
Multiple response (MR) items—such as multiple true-false, multiple-select, and select-N items—are increasingly used in assessments to identify partial knowledge and differentiate latent abilities more accurately. Allowing multiple selections, MR items provide richer information and reduce guessing effects compared to single-answer multiple-choice items. However, traditional scoring methods (e.g., Dichotomous, Ripkey, Partial scoring) compress response combination (RC) data, losing valuable information and ignoring issues like local dependence and incompatibility across item types. To address these challenges, we introduce a novel psychometric model framework: the Multiple Response Model with Inter-option Local Dependencies (MRM-LD), and its simplified version, the Multiple Response Model (MRM). These models preserve RC data across MR item types, offering a more comprehensive understanding for MR assessment. Parameters for MRM-LD and MRM were estimated using Markov chain Monte Carlo algorithms in Stan and R. Empirical data from an eighth-grade physics test showed that MRM-LD and MRM outperform Graded Response Model and Nominal Response Model combined with three scoring methods, by retaining more test information, improving reliability and validity, and providing more detailed analysis of item characteristics. Simulation studies confirmed the proposed models perform robustly under various conditions, including small samples and few items, demonstrating their applicability across diverse testing scenarios.
Test fairness is a major concern in psychometric and educational research. A typical approach for ensuring test fairness is through differential item functioning (DIF) analysis. DIF arises when a test item functions differently across subgroups that are typically defined by the respondents’ demographic characteristics. Most of the existing research focuses on the statistical detection of DIF, yet less attention has been given to reducing or eliminating DIF. Simultaneously, the use of computer-based assessments has become increasingly popular. The data obtained from respondents interacting with an item are recorded in computer log files and are referred to as process data. In this article, we propose a novel method within the framework of generalized linear models that leverages process data to reduce and understand DIF. Specifically, we construct a nuisance trait surrogate with the features extracted from process data. With the constructed nuisance trait, we introduce a new scoring rule that incorporates respondents’ behaviors captured through process data on top of the target latent trait. We demonstrate the efficiency of our approach through extensive simulation experiments and an application to 13 Problem Solving in Technology-Rich Environments items from the 2012 Programme for the International Assessment of Adult Competencies assessment.
Belief network analysis (BNA) has enabled major advances in the study of belief systems, capturing Converse’s understanding of the interdependence among multiple beliefs (i.e., constraint) more intuitively than many conventional statistics. However, BNA struggles with representing political divisions that follow a spatial logic, such as the “left–right” or “liberal-conservative” ideological divide. We argue that Response Item Networks (ResINs) have important advantages for modeling political cleavage lines as they organically capture belief systems in a latent ideological space. In addition to retaining many desirable properties inherent to BNA, ResIN can uncover ideological polarization in a visually intuitive, theoretically grounded, and statistically robust fashion. We demonstrate the advantages of ResIN by analyzing ideological polarization with regard to five hot-button issues from 2000 to 2020 using the American National Election Studies (ANES), and by comparing it against an equivalent procedure using BNA. We further introduce system-level and attitude-level polarization measures afforded by ResIN and discuss their potential to enrich the analysis of ideological polarization. Our analysis shows that ResIN allows us to observe much more detailed dynamics of polarization than classic BNA approaches.
Instrumental activities of daily living (iADLs) are critical in aging and neurodegenerative research, both diagnostically (e.g., distinguishing dementia from mild cognitive impairment) and as endpoints for trials maintaining or improving functioning. However, measurement has not consistently kept pace with a changed world wherein the ability to navigate technology is pertinent to maintaining independent functioning. The current study used harmonization approaches to link traditional and technological iADLs measures using two samples.
Methods:
262 individuals (53.4% women, 91.7% non-Hispanic White, Mage = 76.2, Meducation = 15.6) completed both measures: (1), the Functional Activities Questionnaire (FAQ), and (2), the new Expanded FAQ. Item response theory (IRT) analyses extracted item parameters to characterize measure psychometrics and accurately determine individual functional ability. Harmonization was done using both nonequivalent groups anchor test (NEAT) and equipercentile linking methods with supplementary traditional iADL parameter estimates from the National Alzheimer Coordinating Center (n = 48,605).
Results:
Correlations verified the measures were sufficiently related (rs = .79), and confirmatory factor analyses and reliability determined all items assessed a single construct. Items from both measures complemented each other to provide more information about milder and more severe functional change. NEAT models converged to provide IRT linking equations and equipercentile conversation tables.
Conclusion:
This study provides critical information for harmonizing evolving technological iADLs with traditional iADLs that are assessed in longstanding cohorts. It further provides support for use of an expanded FAQ.
This chapter provides an overview of quantitative approaches to psychological assessment, focusing on measurement instruments used in mental health research. It traces the origins of psychological measurement, outlines its limitations, and explains essential psychometric properties—reliability, validity, and standardisation—needed for selecting high-quality tools. The discussion includes advances in psychometric theory, such as measurement invariance, and their implications for fair and responsible assessment. Practical considerations for test selection, interpretation, and application are highlighted, emphasizing the importance of culturally sensitive and scientifically robust methods. The chapter concludes with reflections on the future of psychological assessment in research and practice.
Promoting mental health, preventing mental disorders and providing effective treatments are public health priorities. Randomized controlled trials (RCTs) frequently evaluate mental health and psychosocial support interventions to achieve one or more of these objectives. Distinguishing between RCTs focused on mental health promotion, prevention or treatment remains conceptually and methodologically challenging. No standardized tool exists to position RCTs along a promotion-to-treatment continuum in mental health. We aimed to develop and validate the VErona-LUgano Tool (VELUT) for distinguishing RCTs along the promotion-to-treatment continuum.
Methods
An interdisciplinary tool development group (TDG) was established. The Population, Intervention, Comparison and Outcome framework was used to define key constructs. Items in the tool were devised, categorized and reduced through qualitative and quantitative methods. Finally, we performed a preliminary validation of the VELUT applying item response theory (IRT) using data from 180 RCTs.
Results
The TDG generated 33 items for the initial version of the VELUT, reduced to 16 through review, cognitive interviews and psychometric analysis. Analyses of 180 RCTs using the 16-item tool showed high internal consistency (α = 0.94) and unidimensionality. Following item reduction and IRT, a final 8-item version was retained, and IRT models confirmed strong item discrimination for the 8 items and high scale reliability (marginal reliability >0.90 across most of the range of the scale), good response distribution, item performance and alignment with the Institute of Medicine (IOM) promotion-to-treatment continuum.
Conclusions
The VELUT addresses methodological gaps in global mental health research by helping to position RCTs of MHPSS interventions along the IOM promotion-to-treatment continuum.
Advances in deep learning and representation learning have transformed item factor analysis (IFA) in the item response theory (IRT) literature by enabling more efficient and accurate parameter estimation. Variational autoencoders (VAEs) are widely used to model high-dimensional latent variables in this context, but the limited expressiveness of their inference networks can still hinder performance. We introduce adversarial variational Bayes (AVB) and an importance-weighted extension (IWAVB) as more flexible inference algorithms for IFA. By combining VAEs with generative adversarial networks (GANs), AVB uses an auxiliary discriminator network to frame estimation as a two-player game and removes the restrictive standard normal assumption on the latent variables. Theoretically, AVB and IWAVB can achieve likelihoods that match or exceed those of VAEs and importance-weighted autoencoders (IWAEs). In exploratory analyses of empirical data, IWAVB attained higher likelihoods than IWAE, indicating greater expressiveness. In confirmatory simulations, IWAVB achieved comparable mean-square error in parameter recovery while consistently yielding higher likelihoods, and it clearly outperformed IWAE when the latent distribution was multimodal. These findings suggest that IWAVB can scale IFA to complex, large-scale, and potentially multimodal settings, supporting closer integration of psychometrics with modern multimodal data analysis.
Obsessive–compulsive disorder (OCD) is a neuropsychiatric disorder characterized by recurrent intrusive thoughts and ritualized behaviors, often aimed at reducing distress. OCD is heterogeneous in its presentation and many patients with OCD experience a variety of different symptoms throughout their course of illness. Efforts to understand symptom domains in OCD have typically identified three to five symptom domains, such as the domains of doubt/checking, contamination, superstitions/rituals, symmetry/hoarding, and taboo thoughts. Recent studies in the genetics of OCD have suggested a common OCD dimension may provide additional information above and beyond the previously identified symptom domains. Thus, we sought to test a hierarchical model of lifetime OCD symptoms and evaluate the utility of the inclusion of a common OCD dimension.
Methods
Participants included 999 individuals participating in the OCD Collaborative Genetics Study (OCGS) and an additional 2363 individuals participating in the OCD Genetic Association Study (OCGAS). We evaluated unidimensional, 5-factor, and hierarchical models of lifetime OCD symptom presentation using confirmatory factor analysis.
Results
Results suggested that the hierarchical model best fit the data. Further evaluation of these models using a Bayesian testlet response model showed that lifetime presence of specific OCD symptoms was differentially associated with lifetime OCD severity. Moreover, symptoms associated with greater lifetime severity were generally reported less frequently than symptoms present at lower levels of lifetime severity. Implications of these findings and future directions are discussed.
The article proposes a novel item response theory model to handle continuous responses and sparse polytomous responses in psychological and educational measurement. The model extends the traditional two-parameter logistic model by incorporating a precision parameter, which, along with a beta distribution, forms an error component that accounts for the response continuity. Furthermore, transforming ordinal responses to a continuous scale enables the fitting of polytomous item responses while consistently applying three parameters per item for model parsimony. The model’s accuracy, stability, and computational efficiency in parameter estimation were examined. An empirical application demonstrated the model’s effectiveness in representing the characteristics of continuous item responses. Additionally, the model’s applicability to sparse polytomous data was supported by cross-validation results from another empirical dataset, which indicates that the model’s parsimony can enhance model-data fit compared to existing polytomous models.
No research has assessed Hamilton Rating Scale for Anxiety (HRSA) psychometric properties in Ethiopian university students, using item response theory (IRT) and classical theory.
Aims
This study aimed to assess psychometric properties of the English HRSA in Ethiopian students, using IRT and classical theory.
Method
University students (N = 370, age 21.44 ± 2.30 years) in Ethiopia participated in a cross-sectional study. Participants completed a self-reported measure of anxiety, a sociodemographics tool and interviewer-administered HRSA.
Results
Confirmatory factor analysis (CFA) favoured a one-factor structure because fit indices for the one-factor model; and two distinct two-factor models were similar, but high interfactor correlations violated discriminant validity criteria in two-factor models. This one-factor structure showed structural invariance as evidenced by multi-group CFA across gender groups. No ceiling/floor effects were seen for the HRSA total scores. Infit and outfit mean square values for all the items were within the acceptable range (0.6–1.4). Four threshold estimates (τi1, τi2, τi3 and τi4) for each item were ordered as expected. Differential item functions showed item-level measurement invariance for all the 14 HRSA items across gender for both uniform and non-uniform estimates. McDonald’s ω and Cronbach’s α for the HRSA tool were both 0.88. The convergent validity of the interviewer-administered HRSA with self-reported anxiety subscale of the 21-item Depression, Anxiety and Stress Scale was weak to moderate.
Conclusions
The findings favour the validity of a one-factor structure of the HRSA with adequate item properties (classical and rating scale model), convergent validity, reliability and measurement invariance (structural and item level) across gender groups in Ethiopian university students.