To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
What happens when we track Shakespeare’s language using computers and large-scale databases like EEBO-TCP? In this study, we begin with a question from a computer scientist (what’s Shakespeare’s ‘favourite’ word?), and follow it through to a consideration of Shakespeare’s reading and influences, and evidence and uncertainty in quantitative literary analysis. We are used to looking for words Shakespeare might have invented, but what about those he picked up from other writers? Might they not be more interesting in terms of understanding how his imagination worked? We identify one such word – ‘sequent’ – which no other major dramatist uses, but which Shakespeare returns to, in different grammatical roles, and with different stylistic resonances, nine times – and of which he becomes especially fond in the years 1600–1605. Our aim is to highlight the history of a single word, and track its passage through print generally, and specifically in Shakespeare, but also to demonstrate the richness digital tools and methods can bring to traditional reading.
The layperson’s seemingly automatic reaction to Shakespeare’s language is to comment on the huge number of words he apparently created. Only relatively recently have scholars been attempting to establish the truth of this. Jonathan Hope has examined sixteen words (“gloomy”, “eyeball”, “manager”, etc.) claimed to be Shakespeare neologisms, and shows that none stand up to scrutiny – all can be antedated. However, how exactly other early modern playwrights were using affixes – the prefixes and suffixes that build words – is not well known. Perhaps the penchant applied more generally to the playwrights of that period. This chapter examines Shakespeare’s affixes, their frequencies and patterns of use, and, importantly, how they compare with those of his contemporaries. All this is made possible by the Enhanced Shakespearean Corpus, a richly annotated set of corpora built for the analysis and comparison of Shakespeare’s language by the Encyclopaedia of Shakespeare’s Language Project (http://wp.lancs.ac.uk/shakespearelang/).
This chapter combines digital search tools with traditional philological methods to explore Shakespeare’s use of the linguistic repertoires embodied in the Book of Common Prayer and English translations of the Bible. On a daily, weekly, and yearly basis, Shakespeare (not to mention his readers and playgoing audience) heard and repeated the regimen of biblical quotations, prayers, and theological propositions encoded in the Book of Common Prayer. These repetitions made available a kind of embodied dictionary of formal categories and templates. Shakespeare’s plays and poems make extensive use of that dictionary. When Shakespeare filled these forms, he did so by selecting words and fitting them to the form in sometimes surprising ways. This chapter argues that the dramatic and poetic power of Shakespeare’s language derives from this filling of words with forms. Indeed, many of Shakespeare’s uses of forms from the Book of Common Prayer or the Bible carry with them what we call content or semantic features, so that our experience of Shakespeare’s language is in fact a register of Shakespeare’s experience of the language of the Bible.
Recent advances in data-driven behavioural science and, particularly, in Behavioural Data Science, saw the rise of applying natural language processing techniques to understanding and modelling human behaviour, algorithmic behaviour, as well as behaviour of complex human–machine systems. From associative modelling in the standard psychological experiments to understanding emotional arcs in novels and movies through the way humans, algorithms and complex systems use language, this chapter demonstrates how computational linguistics methods allow behavioural methodology to go beyond the ‘sterile’ laboratory environments into the field using data, test hypotheses at scale and have scalable practical impact. This chapter also shows how language-based modelling can shed light on cognition, decision-making, judgements and cultural evolution. Using empirical example of a large-scale Behavioural Data Science study, this chapter also demonstrates how language analysis can be used as a ‘truth serum’, helping to obtain underlying human preferences from subjective judgements usually provided in surveys.
Design and innovation processes primarily synthesize the knowledge of existing technological artifacts. Understanding the foundations of such artifact-level knowledge is essential for enabling the knowledge retrieval and representation that govern these syntheses. In this study, we analyze a large, stratified sample of 33,881 patent descriptions across the total technology space. We populate knowledge graphs of these descriptions by combining factual triplets (entity:: relationship:: entity) extracted at the sentence level. From these knowledge graphs, we uncover the linguistic and structural foundations of the knowledge of technological artifacts. Linguistically, we identify syntactic patterns that explain how entities and relationships are constructed at the term level. Structurally, we identify motifs, including dominant 3-node and 4-node subgraph patterns, that reveal how entities and relationships are combined locally in artifact descriptions. Delving into these motifs reveals that natural language artifact descriptions primarily capture the design hierarchy of artifacts. At a local level within artifact descriptions, the motif analyses reveal that only abstract technical knowledge is captured, indicating potential limitations of relying on text-mining for knowledge-intensive tasks. Based on these observations, we propose and demonstrate knowledge specification strategies that can help simplify and modularize knowledge structures populated from technological artifact descriptions.
Democratic resilience is as much about the narratives of our nation we affirm, as the institutions that enshrine our values and laws, a fact re-affirmed by scholarship across many branches of social science in recent decades. For policymakers and quantitative social scientists, analysing or tracking public discourse through the lens of narrative and framing has historically involved the annotation of texts by hand, placing severe limitations on the scale and modality of discourse under inquiry. Yet, a revolution is at hand—a transformer revolution: first arising in computer science, and now enabling a new kind of automated narrative analysis at scale, transformers are opening up new horizons for the tracking of public narratives of democratic resilience. Here, we: formulate a conceptual framework linking computational language methods to democratic resilience analysis; introduce transformer-based artificial intelligence (AI) methods as a third wave in natural language processing technology; and demonstrate two practical applications of transformer methods to democratic narrative analysis. Finally, we conclude by contributing data and research recommendations which flow naturally from the opportunities unlocked by transformer methods for public stakeholders who wish to see these opportunities realised. Together, we suggest that, perhaps for the first time, the “holy grail” of the quantitative social scientist is near: the ability to identify, accurately, and efficiently, nuanced narratives in text, at scale.
The development of artificial intelligence and machine learning is leading to a revolution in the way we think about economic decisions. The Economics of Language explores how the use of generative AI and large language models (LLMs) can transform the way we think about economic behaviour. It introduces the LENS framework (Linguistic content triggers Emotions and suggests Norms, which shape Strategy choice) and presents empirical evidence that LLMs can predict human behaviour in economic games more accurately than traditional outcome-based models. It draws on years of research to provide a step-by-step development of the theory, combining accessible examples with formal modelling. Offering a roadmap for future research at the intersection of economics, psychology, and AI, this book equips readers with tools to quantify the role of language in decision-making and redefines how we think about utility, rationality, and human choice.
Chapter 7 discusses how language and computer use interact and some of the problems that can occur when relying on natural language processing and machine learning. We discuss some of the benefits and challenges of automatic parsing, how algorithms are applied and can alter what gets shown in searches, and more. We provide several examples of AI generation gone wrong and encourage caution when using large language models, but also how knowledge about linguistics and how language works can inform our own use of language-based technology.
Why can't we say the asleep cat? There is a class of adjectives in English, all of which start with a schwa (e.g. afraid, alone, asleep, away, etc.), that cannot be used attributively in a prenominal position. A frequently invoked strategy for the acquisition of such negative constraints in language is to use indirect negative evidence. For instance, if the learner consistently observes paraphrases such as the cat that is asleep, then the conspicuous absence of the asleep cat may be a clue for its ungrammaticality (Boyd & Goldberg 2011). This article provides formal and quantitative evidence from child-directed English data to show that such learning strategies are untenable. However, the child can rely on positive data to establish the distributional similarities between this apparently idiosyncratic class of adjectives and locative particles (e.g. here, over, out, etc.) and prepositional phrases. With the use of an independently motivated principle of generalization (Yang 2005), the ungrammaticality of attributive usage can be effectively extended to the adjectives in question.
The birthdate of both generative linguistics and neural networks can be taken as 1957, the year of the publication of foundational work by both Noam Chomsky and Frank Rosenblatt. This article traces the development of these two approaches to cognitive science, from their largely autonomous early development in the first thirty years, through their collision in the 1980s around the past-tense debate (Rumelhart & McClelland 1986, Pinker & Prince 1988) and their integration in much subsequent work up to the present. Although this integration has produced a considerable body of results, the continued general gulf between these two lines of research is likely impeding progress in both: on learning in generative linguistics, and on the representation of language in neural modeling. The article concludes with a brief argument that generative linguistics is unlikely to fulfill its promise of accounting for language learning if it continues to maintain its distance from neural and statistical approaches to learning.
Distributional approaches following the Firthian principle have revolutionized linguistics. While Firthian approaches in collocation research detect syntagmatic relations and are a key research area in corpus linguistics, Firthian distributional semantics and their neural counterpart of word embeddings detect paradigmatic relations and have fundamentally impacted computational linguistics. We combine these two closely related approaches: our hypothesis, following Ricoeur’s view of a metaphor as a clash of two normally distinct semantic fields, is that idioms are collocations in which the lexical participants typically have low semantic similarity in the word embedding space, i.e. low values for the cosine metric. We test if the cosine metric, replaceability with synonyms, and linear combinations with collocation measures improve idiom detection for three constructions: verb-PP, light verbs, and compound nouns. We report improved idiom detection by 10 to 80 per cent, and almost half of compound noun non-compositionality is predicted by cosine alone. We trace how compound nouns are changing in spoken and written English, mirroring digitalisation and the revolution of the internet.
This study investigates unintended information flow in large language models (LLMs) by proposing a computational linguistic framework for detecting and analyzing domain anchorage. Domain anchorage is a phenomenon potentially caused by in-context learning or latent “cache” retention of prior inputs, which enables language models to infer and reinforce shared latent concepts across interactions, leading to uniformity in responses that can persist across distinct users or prompts. Using GPT-4 as a case study, our framework systematically quantifies the lexical, syntactic, semantic, and positional similarities between inputs and outputs to detect these domain anchorage effects. We introduce a structured methodology to evaluate the associated risks and highlight the need for robust mitigation strategies. By leveraging domain-aware analysis, this work provides a scalable framework for monitoring information persistence in LLMs, which can inform enterprise guardrails to ensure response consistency, privacy, and safety in real-world deployments.
Advances in natural language processing (NLP) and Big Data techniques have allowed us to learn about the human mind through one of its richest outputs – language. In this chapter, we introduce the field of computational linguistics and go through examples of how to find natural language and how to interpret the complexities that are present within it. The chapter discusses the major state-of-the-art methods being applied in NLP and how they can be applied to psychological questions, including statistical learning, N-gram models, word embedding models, large language models, topic modeling, and sentiment analysis. The chapter concludes with ethical discussions on the proliferation of chat “bots” that pervade our social networks, and the importance of balanced training sets for NLP models.
Framenets and constructiCons are applied instantiations of the linguistic frameworks known as Frame Semantics and Construction Grammar, respectively, in the form of computational, semiformally structured linguistic resources. The resources have a common history, both theoretically and in design: They are built as English-language resources in the framework of the Berkeley FrameNet initiative. They enjoy the double nature of being descriptive linguistic resources as well as finding frequent use in a computational linguistic context, where they have been used both in NLP applications and as underlying knowledge bases in areas such as computer-assisted language learning. The chapter provides a bird’s-eye view on these resources: their theoretical foundations; design principles and how they are compiled; theoretical and methodological interrelations; the challenges involved in building framenets and constructiCons for new languages and for cross-linguistic application; the differences and interactions between linguistic and computational linguistic work on framenets and constructiCons; application to language pedagogy; and outstanding theoretical and methodological issues.
Language is the natural currency of most social communication. Until the emergence of more powerful computational methods, it simply was not feasible to measure its use in mainline social psychology. We now know that language can reveal behavioral evidence of mental states and personality traits, as well as clues to the future behavior of individuals and groups. In this chapter, we first review the history of language research in social personality psychology. We then survey the main methods for deriving psychological insights from language (ranging from data-driven to theory-driven, naturalistic to experimental, qualitative to quantitative, holistic to granular, and transparent to opaque) and describe illustrative examples of findings from each approach. Finally, we present our view of the new capabilities, real-world applications, and ethical and psychometric quagmires on the horizon as language research continues to evolve in the future.
This chapter surveys the history and main directions of natural language processing research in general, and for Slavic languages in particular. The field has grown enormously since its beginning. Especially since 2010, the amount of digital texts has been rapidly growing; furthermore, research has yielded an ever-greater number of highly usable applications. This is reflected in the increasing number and attendance of NLP conferences and workshops. Slavic countries are no exception; several have been organising international conferences for decades, and their proceedings are the best place to find publications on Slavic NLP research. The general trend of the evolution of NLP is difficult to predict. It is certain that deep learning, including various new types (e.g. contextual, multilingual) of word embeddings and similar ‘deep’ models will play an increasing role, while predictions also mention the increasing importance of the Universal Dependencies framework and treebanks and research into the theory, not only the practice, of deep learning, coupled with attempts at achieving better explainability of the resulting models.
The introduction to this volume describes its content. It also provides the rationale for including selected topics and provides comments on the manner of presentation adopted in this volume.
The linguistic study of the Slavic language family, with its rich syntactic and phonological structures, complex writing systems, and diverse socio-historical context, is a rapidly growing research area. Bringing together contributions from an international team of authors, this Handbook provides a systematic review of cutting-edge research in Slavic linguistics. It covers phonetics and phonology, morphology and syntax, lexicology, and sociolinguistics, and presents multiple theoretical perspectives, including synchronic and diachronic. Each chapter addresses a particular linguistic feature pertinent to Slavic languages, and covers the development of the feature from Proto-Slavic to present-day Slavic languages, the main findings in historical and ongoing research devoted to the feature, and a summary of the current state of the art in the field and what the directions of future research will be. Comprehensive yet accessible, it is essential reading for academic researchers and students in theoretical linguistics, linguistic typology, sociolinguistics and Slavic/East European Studies.
In this chapter, a case is made for the inclusion of computational approaches to linguistics within the theoretical fold. Computational models aimed at application are a special case of predictive models. The status quo in the philosophy of linguistics is that explanation is scientifically prior to prediction. This is a mistake. Once corrected, the theoretical place of prediction is restored and, with it, computational models of language. The chapter first describes the history behind the emergence of explanation over prediction views in the general philosophy of science. It’s then suggested that this post-positivist intellectual milieu influenced the rejection of computational linguistics in the philosophy of theoretical linguistics. A case study of the predictive power already embedded in contemporary linguistic theory is presented through some work on negative polarity items. The discussion moves to the competence–performance divide informed by the so-called Galilean style in linguistics that retains the explanatory over prediction ideal. In the final sections of the chapter, continuous methods, such as probabilistic linguistics, are used to showcase the explanatory and predictive possibilities of nondiscrete approaches, before a discussion of the contemporary field of deep learning in natural language processing (NLP), where these predictive possibilities are further amplified.
What is the remit of theoretical linguistics? How are human languages different from animal calls or artificial languages? What philosophical insights about language can be gleaned from phonology, pragmatics, probabilistic linguistics, and deep learning? This book addresses the current philosophical issues at the heart of theoretical linguistics, which are widely debated not only by linguists, but also philosophers, psychologists, and computer scientists. It delves into hitherto uncharted territory, putting philosophy in direct conversation with phonology, sign language studies, supersemantics, computational linguistics, and language evolution. A range of theoretical positions are covered, from optimality theory and autosegmental phonology to generative syntax, dynamic semantics, and natural language processing with deep learning techniques. By both unwinding the complexities of natural language and delving into the nature of the science that studies it, this book ultimately improves our tools of discovery aimed at one of the most essential features of our humanity, our language.