Accurate psychiatric assessment requires understanding a person’s unique experience within their psychosocial context. Clinical interviews have been the gold standard for assessment as the only methods capable of this complex task, but they are time and resource-intensive. Consequently, psychiatric assessment typically relies on patient report surveys that are decontextualized and narrow in scope. This comprehensiveness-scalability tradeoff is a major bottleneck in studying and treating psychopathology. We propose using large language models (LLMs) to score psychopathology from brief personal narratives as a low-burden, context-sensitive solution.

Participants (N = 108) completed brief (~1 minute), freeform audio diaries daily for 2 weeks. We used six LLMs to score wide-ranging psychopathology (Internalizing, Detachment, Disinhibition, Antagonism, Anankastia) from the diary transcripts. Leveraging an array of self-report and clinical interview measures, we tested the convergent, discriminant, concurrent, and clinical validity of LLM ratings for between-person differences and within-person fluctuations in psychopathology.

Supporting convergent and discriminant validity, LLM ratings correlated most strongly with corresponding self-report domains at the between (average convergent r = .42) and within-person (r = .28) levels. LLM and self-report ratings had similar patterns of associations with external variables, except for Anankastia and Antagonism. Further, every LLM-rated domain related to psychopathology ascertained by clinical interview.

Across multiple forms of validity, we showed that LLMs can assess most major forms of psychopathology from mere minutes of audio. These results support scoring open-ended narratives with LLMs as a scalable, portable method to translate idiographic diagnostic data into standardized psychiatric assessments.

The Hierarchical Taxonomy of Psychopathology (HiTOP) offers a promising framework to identify the neurobiological mechanisms of psychopathology. Many forms of psychopathology are characterized by dysfunctional emotional reactivity. The late positive potential (LPP) is an event-related potential component that provides an index of neurobiological emotional reactivity. Several categorical disorders have demonstrated a similar association with the emotion-modulated LPP. It is possible that higher-order dimensional representations of psychopathology might explain the comparable results. The present study examined the association between HiTOP-consistent pathological personality dimensions across multiple levels of the hierarchy and neurobiological emotional reactivity.

The sample included 215 18–35-year-old adults (86% female) who were oversampled for psychopathology. Participants completed the emotional interrupt task while electroencephalography was recorded to examine the LPP. Participants also completed the Comprehensive Assessment of Traits relevant to Personality Disorders to assess pathological personality.

At the spectra level, higher negative emotionality was associated with a larger emotion-modulated LPP, while higher detachment was associated with a smaller emotion-modulated LPP. There were no associations between higher-order psychopathology levels and the emotion-modulated LPP. Compared to categorical diagnoses, spectra-level personality pathology dimensions significantly improved the prediction of the emotion-modulated LPP.

The present study indicates that HiTOP spectra levels of negative emotionality and detachment demonstrate unique associations with neurobiological emotional reactivity. The study highlights the utility of examining dimensional and hierarchical, rather than categorical, representations of psychopathology in the attempt to identify the neurobiological origins of psychopathology.