To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
Formal thought disorder (FTD) has been conceptualized as a categorical syndrome of psychosis, but this remains untested. Clarifying whether FTD is categorical or continuous and its supra-thres hold prevalence in non-clinical populations has direct implications for bears directly on mechanistic studies of FTD, psychosis prediction, and early intervention.
Methods
In a multi-site cross-sectional study of 520 individuals (352 clinical, 168 non-clinical), we used the Thought and Language Index to assess FTD across three subconstructs: Loosening, Peculiarities, and Impoverishment. Using complementary taxometric procedures (MAMBAC, MAXEIG, and L-Mode) with simulation of comparison data and multiple thresholding approaches (minimally important change criteria, ROC analysis, intuitive binarization), we evaluated the latent structure of FTD, optimal cutoff points to estimate FTD prevalence, and the frequency of co-occurrence of subconstructs.
Results
Taxometric analyses revealed a predominantly dimensional latent structure for FTD across various base rates. Among healthy individuals, Peculiarities were uncommon (1.2%), but 11.3% exhibited Loosening and 8.9% had Impoverishment even with conservative thresholds. Multi-construct co-occurrence exceeded chance across the sample but was restricted to patients at conservative clinical thresholds.
Conclusions
FTD exists in a continuous dimensional structure extending into healthy populations. Each dimension is measurable in healthy individuals, but multi-dimensional convergence at clinical thresholds (i.e. disorder with functional impairment) appears specific to patients. This suggests that common vulnerability factors increase the likelihood of elevations across multiple but substantially independent dimensions of FTD. As a hypothesis requiring prospective validation, clinical risk of psychosis may depend on the coalescence rather than single-dimensional severity of FTD subconstructs.
Archaeological context is a foundational concept, yet its definition remains ambiguous and inconsistent. Traditionally, lithostratigraphic frameworks rooted in geology have long dominated, but recent computational and spatial approaches increasingly redefine stratigraphic units. This shift raises a critical challenge: the lack of clear and consistent terminology for defining stratigraphic units. To explore this issue, we applied natural language processing (NLP) to a broad corpus of Paleolithic literature, focusing on the use of key terms such as “layer,” “level,” “occupation,” and “horizon.” Using SciBERT (Scientific BERT; BERT = Bidirectional Encoder Representations from Transformers) to generate contextual embeddings, we compared their semantic distributions with a control set of distinct terms (lithic, bone, flake, charcoal). The control set produced stable, separable clusters, whereas contextual terms showed extensive semantic overlap and instability, reflecting their interchangeable and inconsistent use. These results underscore that the problem is not only linguistic but theoretical: without clear terminological baselines, new methodological advances risk conflating analytical tools with interpretive outcomes. We argue that terminological precision is essential for comparability across sites and for cumulative research. NLP offers a replicable framework for auditing and clarifying terminology, contributing to greater rigor and interoperability in archaeological interpretation.
Sentimental analysis (SA) of movie reviews has become an essential means of supporting audiences, filmmakers, and investors to facilitate data-driven marketing, support audience engagement, and maximize audience development returns. Nevertheless, current SA models are yet to overcome potentially daunting problems such as noisy data, ambiguity of language, limited handling of negations, and a loss of rich semantic information during mirror preprocessing that ultimately decreases classification performance. To overcome this hurdle, a unique two-stage strategy entitled Hierarchical Attention-Guided Sentiment Network (HASN) is proposed that enables reliable and interpretable sentiment predictions. The first stage includes a clearly defined preprocessing pipeline of the IMDb dataset that features text cleaning, lemmatizing, removing stop words, negation, TF-IDF filtering of low-frequency terms, and lastly, Word2Vec embeddings, which create semantically consistent and contextually rich representations of potential inputs. The second stage integrates a tri-stream attention recurrent extractor (TARE), which reconstructs and merges previously learned outputs with the learned syntactic and semantic contexts with the benefits of stacked Bi-LSTMs, combines learned syntactic and semantic contexts with multi-head attention to identify the tokens that drive sentiment, and ends with a residual-normalized GRU (ResNorm-GRU), which sequentially refines the sequential process of intake. The attentive conditional random field (Attn-CRF) serves as a classifier by boosting coherence in label predictions through attention weighting with modeling of the sequential dependencies. The experiments with the IMDb dataset demonstrated that the best results detected were the following: 98.09, 98.47, 97.70, and 98.08%. In summary, the HASN framework is a precise, scalable, and interpretable model for analyzing sentiments in movie reviews.
Automatic named entity recognition (NER) is essential for many natural language processing applications, particularly in low-resource languages and those with corpora restricted to a single domain, where the lack of diverse data may hinder cross-domain generalisation. In this context, we attempt to contribute to the Galician NER field by extending manually annotated resources and exploring several approaches to improve the performance of automatic classifiers. To this end, we enrich two new datasets with NER annotations in Galician, which we release in this paper. Through experimental evaluation, we investigate the benefits of fine-tuning transformers on NER data by comparing various monolingual and multilingual BERT models and developing a new extra-small DeBERTa model for Galician. Furthermore, we assess the quality of the NER model by expanding the initial training corpus with additional data from related varieties, including Portuguese and Spanish. For evaluation, we use five Galician corpora, including our two newly annotated datasets and three adapted from existing resources, ensuring assessment across multiple domains. Our findings reveal (1) a positive impact of enhanced cross-lingual training data on improved model performance across five Galician test datasets; (2) similar performance of monolingual and multilingual models depending on the training data; and (3) the competitive effectiveness of extra-small BERT models for Galician NER tasks compared to larger models.
For decades, public opinion scholars have argued for the need to go beyond measuring isolated political preferences to more richly examine how individuals reason about and justify the interconnections between their preferences. While early efforts used interviews and hand-coding to elicit the network structure of subjects’ political reasoning, this manual approach can be time-consuming and difficult. Thankfully, modern computational methods and computing power hold the potential to revolutionize this space and allow for network inference at scale. In this paper, we therefore present a computational, text-based approach for inferring the network structure of individuals’ political reasoning. This method identifies the key concepts a person raises and examines the implicit connections between those concepts—what ideas do they connect to which other ideas? This structural approach is theoretically justified in both the cognitive and linguistic literatures, which repeatedly suggest that humans store, retrieve, and interpret information through network structures. We show that this approach reveals meaningful individual variation that is correlated with known behavioral traits. The ability to measure and interrogate individuals’ expressions of political reasoning holds the potential to shed new light on the dynamics of public opinion and political behavior. Questions of persuasion, ideological fracturing, and conversation quality all rely upon understanding individual styles of political expression. These dynamics are driven not just by what someone says but by how they say it.
Cognitive impairment is associated with language changes that emerge during verbal responses to neuropsychological assessments that traditional scoring does not capture. The current study investigated the utility of a linguistic analysis of paragraph recall responses for detecting cognitive impairment.
Methods:
Digital voice recordings of logical memory (LM) were available from 598 Long Life Family Study participants with normal cognition and 112 with cognitive impairment. Linguistic polyfeature scores for immediate (PFS-IR) and delayed recall (PFS-DR) were created from weighted sums of features associated with cognitive impairment. Logistic regression models assessed the predictive value of each PFS for classifying cognitive impairment. Repeated measures models with generalized estimating equations assessed whether PFSs predict cognitive screener performance over time.
Results:
Twelve linguistic features and higher PFSs were associated with cognitive impairment (PFS-IR OR = 1.05; PFS-DR OR = 1.07). PFS-DR scores approximated the accuracy of traditional LM scoring (AUC-PR = 0.77 vs. 0.81, respectively). A higher PFS-DR was also associated with lower cognitive screener scores over an average of 7 years of follow-up (β = –0.08, 95% CI [–0.11, –0.06]).
Conclusion:
Quantification of linguistic features from paragraph recall identified distinct linguistic markers that reflect differences in learning, retention, and self-monitoring. Summary feature scores detected cognitive impairment and predicted lower cognitive performance over time. This approach has potential implications for automated testing, recording, and scoring pipelines allowing for implementation of gold-standard neuropsychological assessments in broader clinical and research settings. Further studies are needed to validate these findings across clinical and community-based populations.
Archives are essential vehicles for both historical research and memory practices like genealogy. The sheer volume of documents produced via digital infrastructures, however, has posed a challenge for traditional archival processes that rely on human judgments. Some archivists have responded to this challenge by engaging with research in natural language processing (NLP), a subfield of AI that offers practical tools for working with large corpora of text. In this paper, we review applications of NLP methods in archival processes in order to surface fundamental tensions between archival values and automation. NLP can be used to classify materials as sensitive, recognize names in documents and facilitate new kinds of search, among other applications. Our discussion of these issues follows the journey of a document through an archive, from acquisition to interpretation. We find that sensitivity to context, transparency, resource limitations and maintenance appear as recurring challenges that are complicated by automation. The benefits that NLP technologies lend to managing large archives, however, suggest that these tools should be considered, not discarded. Turning to a more forward-looking discussion of generative AI and archival infrastructure, we argue that the narrative and dialogic potential of contemporary large language models has an especially contentious relationship with conventional archival desiderata.
The practice of public administration is confronted by an overwhelming volume of unstructured textual data, creating a critical bottleneck that challenges the capacity for timely, evidence-based policymaking. While large language models (LLMs) offer a powerful solution, the academic and policy discourse on AI governance has primarily focused on the risks associated with quantitative, predictive models, leaving the governance of LLMs, which involve qualitative, interpretive analysis, critically underexplored. This article provides a systematic and empirical answer to this challenge. We evaluate four distinct archetypes for AI-assisted policy analysis: (1) traditional expert-driven analysis, (2) automated topic modelling, (3) human-in-the-loop LLM co-production (ChatGPT with prompting), and (4) institutional-scale API automation (ChatGPT via API), by applying them to a real-world corpus of 63 United Nations policy documents. Our results reveal the inherent trade-offs of each archetype in terms of analytical speed, cost, contextual depth, and the requisite level of human oversight, finding that the human-in-the-loop model offers the most effective balance. We conclude by presenting a durable framework to guide public institutions in making a strategic, evidence-based choice of analytical workflow, ensuring the adoption of AI strengthens, rather than erodes, the integrity of democratic governance.
Chapter 1 provides an overall introduction to the book and its underlying motivations. It proposes and defines the concept of Clever Computing. It presents the historical emergence of the Internet of Things, AI, and Ubiquitous Computing, and analyses the risks of technological visions of the future which often neglect current social and human needs in favour of techno-led solutions. It explores the need to account for human needs in design and, by extension, legal values. The term Clever Computing is contextualised by exploring different examples of how AI and IoT are increasingly converging. This focuses on the ways AI is changing and improving interaction techniques with IoT; how AI is being used to make sense of IoT data and enabling distributed data analysis; and how AI is augmenting the existing functionality and increasing the autonomy of IoT systems.
Political science increasingly uses text classification to gauge subtle concepts such as toxicity or anger. Traditional methods treat words in isolation, overlooking the contextual dynamics where meaning resides. Transformer-based language models address these limitations but remain underutilized, especially among applied scholars, partly due to misconceptions about their mechanisms and computational requirements. This article bridges this gap by offering an accessible explication of the pretrain-finetune paradigm, focusing on underlying mechanisms and their potential to improve political text analysis by harnessing models trained on extensive datasets while requiring modest labeled data and computational resources. I demonstrate the approach by identifying toxic language in conversation threads following U.S. Senators’ tweets and provide an online tutorial to support nontechnical scholars in adopting the methodology.
Legal epidemiology — the study of how laws influence health outcomes — is an emerging field with potential to inform policy and improve public health. Shortages of specialists who can commit the extensive time required for these analyses has hindered progress in this area. Features of laws make them ideal candidates for artificial intelligence and natural language processing (AI/NLP) to address these constraints: standardized format, defined terms, and common terminology. However, there are concerns regarding valid AI/NLP application, especially given current underreporting of legal research in published policy evaluation studies. Drawing on lessons learned from case deployments and recent literature, we review opportunities and challenges for methods using AI/NLP in scientific legal research: assessing the scope of legal documents and data, identifying and collecting primary legal data, developing and applying coding schemes, and implementing quality controls to ensure the validity of produced legal datasets. We highlight methodologic research areas and innovation in the application of AI/NLP for scientific studies regarding effects of law on health and indicate methodologic reporting elements that will be essential for the field’s innovation. This review provides a method-focused research agenda for AI/NLP in scientific legal epidemiology studies that might accelerate the field’s growth and effects on evidence-based policy.
This chapter examines the application of machine learning in legal contexts, tracing developments from early AI systems to contemporary natural language processing technologies. Machine learning techniques may address access to justice challenges through automated legal analysis and case outcome prediction. This chapter discusses different approaches to extracting useful information from legal documents and analyzes research on predicting legal decisions. A central focus is the tension between powerful but opaque machine learning models and the legal system’s requirement for transparent, explainable reasoning. Key challenges include the difficulty of representing legal cases effectively for machine learning, the limited explanatory capacity of high-performing neural networks, and the gap between how judges and litigants describe facts. While machine learning shows promise for legal applications, significant obstacles remain in developing systems suitable for actual legal practice where explanation and justification are essential.
This chapter provides a foundational introduction to generative AI and large language models, addressing their capabilities and limitations. These models can perform competitively with humans on standardized exams and legal reasoning tasks and can be applied flexibly to legal challenges through natural language prompts.
However, significant limitations constrain their deployment in legal contexts. Models produce hallucinations, generating confident but incorrect information that can mislead users making critical legal decisions. The ELIZA effect compounds this risk as users tend to anthropomorphize AI and overestimate its capabilities. Additional challenges include potential biases introduced by the training data, privacy concerns associated with hosted models, and substantial computational costs. Understanding both the opportunities and limitations is crucial for safely deploying generative AI to address access-to-justice challenges.
Skill extraction is at the core of algorithmic hiring. It is based on identifying terms commonly found in both targets (i.e., resumes and job offers), aiming at identifying a “match” or correspondence between both. This article focuses on skill extraction from resumes, as opposed to job offers, and considers this task both from the human resource management (HRM) and artificial intelligence (AI) points of view. We discuss challenges identified by both fields and explain how collaboration is instrumental for a successful digital transformation of HRM. We argue that annotation efforts are an ideal example of where collaboration between both fields is needed and present an annotation effort on 46 resumes with 41 trained annotators, resulting in a total of 116 annotations. We analyze the skills extracted by multiple different systems and compare those to the skills selected by the annotators, and find that the skills extracted differ a lot in terms of length and semantic content. The skills extracted using conversational large language models (LLMs) tend to be very long and detailed; other systems are concise, whereas humans are in the middle. In terms of semantic similarity, conversational LLMs are closer to human outputs than other systems. Our analysis proposes a different perspective to understand the well-studied, but still unsolved, skill extraction task. Finally, we provide policy recommendations for skill extraction aligned with both HRM and computational perspectives.
Accurate psychiatric assessment requires understanding a person’s unique experience within their psychosocial context. Clinical interviews have been the gold standard for assessment as the only methods capable of this complex task, but they are time and resource-intensive. Consequently, psychiatric assessment typically relies on patient report surveys that are decontextualized and narrow in scope. This comprehensiveness-scalability tradeoff is a major bottleneck in studying and treating psychopathology. We propose using large language models (LLMs) to score psychopathology from brief personal narratives as a low-burden, context-sensitive solution.
Methods
Participants (N = 108) completed brief (~1 minute), freeform audio diaries daily for 2 weeks. We used six LLMs to score wide-ranging psychopathology (Internalizing, Detachment, Disinhibition, Antagonism, Anankastia) from the diary transcripts. Leveraging an array of self-report and clinical interview measures, we tested the convergent, discriminant, concurrent, and clinical validity of LLM ratings for between-person differences and within-person fluctuations in psychopathology.
Results
Supporting convergent and discriminant validity, LLM ratings correlated most strongly with corresponding self-report domains at the between (average convergent r = .42) and within-person (r = .28) levels. LLM and self-report ratings had similar patterns of associations with external variables, except for Anankastia and Antagonism. Further, every LLM-rated domain related to psychopathology ascertained by clinical interview.
Conclusions
Across multiple forms of validity, we showed that LLMs can assess most major forms of psychopathology from mere minutes of audio. These results support scoring open-ended narratives with LLMs as a scalable, portable method to translate idiographic diagnostic data into standardized psychiatric assessments.
Suicide is a significant global public health concern, and conventional clinical risk assessment is constrained by workforce availability, scalability, and clinician variability. The classic suicidality risk evaluation is largely dependent on clinical judgment, which, although helpful, can demonstrate a ceiling effect in its predictive validity. AI-driven chatbots, conversational systems that engage users in real-time natural language dialog, have emerged as candidate tools for augmenting suicide risk detection and prevention. This narrative review aimed to: evaluate the performance of AI-driven chatbots in detecting and assessing suicidal ideation relative to clinical benchmarks; examine the effectiveness of chatbot-based interventions for suicide prevention; and identify ethical, cultural, and implementation challenges limiting clinical translation. Six electronic databases were searched, with the initial search conducted in 2024 and updated in 2026 through targeted monitoring, with no upper cutoff date applied. A thematic narrative synthesis approach was applied across five domains. Eleven primary studies met eligibility criteria and were included in the synthesis. Chatbot-based risk assessment showed adequate response alignment with expert judgment at the extremes of suicide risk, but consistently failed to distinguish intermediate risk levels across multiple model families. Across 29 tested commercial chatbot agents, none met the criteria for an adequate suicidal crisis response. A clinically designed, framework-anchored chatbot achieved high efficacy across six outcome domains. Three percent of social chatbot users reported halted suicidal ideation, and a purpose-built clinical chatbot in emergency department settings significantly improved evidence-based care delivery. Systematic risk severity underestimation and the absence of cross-cultural evaluation were identified across all studies. AI-driven chatbots show potential as adjunctive tools across the suicide care continuum. Clinically designed, evidence-anchored chatbots demonstrate feasibility and meaningful benefit; commercially deployed chatbots without clinical validation demonstrate near-universal crisis response inadequacy. Mandatory clinical validation prior to public release, clinician oversight, and crisis system integration are prerequisites for responsible deployment.
Gauging the extent of public acceptability of reforms is an important concern for policymakers. Timely insights into public perceptions can illuminate how reforms are received and how attitudes evolve over time. In this study, we build on the OECD’s Public Acceptability Tool, a framework encompassing four key dimensions of reform acceptability—Economic, Fairness, Behavioural, and Process—to evaluate the public acceptability of policy reforms. We take the 2023 French pension reform as a relevant case study, using online media articles and parliamentary speeches as indicators of discourse surrounding the reform. Using word embeddings, we classify these texts according to the four dimensions and apply matrix factorisation topic algorithms to uncover the latent themes within each. Our analysis shows that the Process dimension dominated media coverage during the discussion and legislative phases of the reform, consistent with previous literature on pension reforms. In contrast, no particular dimension was predominant in parliamentary speeches, suggesting a mismatch between policy and public debates. Finally, we identify the main topics driving public discussion within each dimension, highlighting notable differences between media narratives and parliamentary discourse that offer further insight into the dynamics of public acceptability.
Linguistic abnormalities in schizophrenia (SCZ) span morphological, syntactic, semantic, and discourse levels. Converging cross-linguistic evidence suggests that SCZ may involve semantic narrowing alongside reduced syntactic differentiation, yet how these changes co-occur across linguistic domains and whether they represent core, task-general disturbances remains unclear. We applied a multilevel NLP framework to a large Japanese dataset to identify structurally related linguistic markers of SCZ across elicitation contexts.
Methods
Speech from 104 patients with SCZ and 101 healthy controls was collected through semi-structured interviews. Transcripts from free conversation, storytelling, and picture description were analyzed using GiNZA, Word2Vec, TF-IDF, and SentenceBERT to extract 76 morphosyntactic, semantic, and discourse features. Factor analysis identified representative features independent of diagnosis, which were tested using generalized estimating equations and validated with bootstrap and permutation procedures. Cross-task stability was examined to determine core linguistic markers.
Results
In free conversation, reduced Case-particle (Kakujoshi) and Adverb use and increased Mean Pairwise Word Similarity were strongly associated with SCZ (AUC = 0.87, 95% CI: 0.74–0.97). Adverbial, case-particle, and semantic-network measures functioned as cross-task markers.
Conclusions
SCZ involves multidimensional language disturbances characterized by a tripartite linguistic phenotype of diminished morphosyntactic explicitness, semantic narrowing, and reduced modification-based contextual modulation in spontaneous discourse. Extending cross-linguistic evidence, our results indicate that lexical-semantic contraction co-occurs with reduced overt marking of argument relations in Japanese, alongside weakened adverbial elaboration and framing – suggesting convergent, largely task-general dimensions of SCZ language pathology, most evident in free conversation.
This chapter examines distributed semantics and language models, Word2Vec and BERT, for obtaining word and sentence embeddings to extract knowledge representations from naturalistic stimuli in behavioural data science applications. These representations enable large-scale study of human cognition and behaviour, providing insights into higher-level psychological processes. Utilising distributed semantics is cost-effective due to pretrained language models’ availability. However, integrating perceptual data with semantic representations is crucial, as these representations are experience-based and may not fully capture complex sentences’ meaning. Future research can address questions like memorability using semantic representations and explore individual differences by training models on data from distinct sub-populations. High-dimensional representations from embedding models offer numerous opportunities to study human behaviour on a larger scale than previously possible.
Recent advances in data-driven behavioural science and, particularly, in Behavioural Data Science, saw the rise of applying natural language processing techniques to understanding and modelling human behaviour, algorithmic behaviour, as well as behaviour of complex human–machine systems. From associative modelling in the standard psychological experiments to understanding emotional arcs in novels and movies through the way humans, algorithms and complex systems use language, this chapter demonstrates how computational linguistics methods allow behavioural methodology to go beyond the ‘sterile’ laboratory environments into the field using data, test hypotheses at scale and have scalable practical impact. This chapter also shows how language-based modelling can shed light on cognition, decision-making, judgements and cultural evolution. Using empirical example of a large-scale Behavioural Data Science study, this chapter also demonstrates how language analysis can be used as a ‘truth serum’, helping to obtain underlying human preferences from subjective judgements usually provided in surveys.