To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
This chapter provides a high-level overview of the complete development and deployment process for generative AI (GenAI) language models, such as those that power systems like ChatGPT and Gemini. It begins by clarifying the distinction between a GenAI model (the core algorithm and code) and a GenAI system (the model plus all necessary infrastructure, user interface, and data management). The discussion then demystifies the technology. Large language models (LLMs) operate by calculating the statistical probability of the next word in a sequence – making them sophisticated, yet fundamentally logic-based, “next-token predictor machines” that lack true comprehension or inherent powers of judgment.
Shie Mannor, Technion - Israel Institute of Technology, Haifa,Yishay Mansour, Tel-Aviv University,Aviv Tamar, Technion - Israel Institute of Technology, Haifa
This preface chapter transitions from planning to learning. The chapter distinguishes RL from supervised learning: While supervised learning uses fixed i.i.d. datasets, RL involves an agent interacting online with an environment. Three main learning paradigms are identified: situated agent setting, offline learning and simulation-based learning. The exploration–exploitation tradeoff is emphasized as fundamental. Success metrics including sample complexity bounds, regret minimization and convergence guarantees are discussed.
This chapter dissects the intense, seemingly irrational boom in generative AI (GenAI), moving beyond superficial hype to reveal the complex, structural incentives driving billions of dollars into an industry with uncertain returns. It argues that the current boom is propelled not purely by altruistic motives or technological inevitability, but by ten powerful forces. These forces – namely, shareholder primacy, financial imperatives, the pursuit of first-mover advantages, insatiable data-collection needs, self-serving safety justifications, fear of losing relevance, the pursuit of prestige, fear of missing out (FOMO), a belief in “manifest destiny,” and regulatory entrepreneurship – collectively prioritize speed, growth, and market capture over caution, sustainability, and societal benefit. By examining these systemic pressures, the chapter provides the framework for understanding the breakneck pace of AI development and for shaping its ultimate deployment.
This chapter discusses the contentious world of web scraping and its essential, yet problematic, role as the lifeblood of generative AI (GenAI) model training. It highlights the vast scale of data required and the subsequent reliance on the internet’s reservoirs: the public, deep, and dark webs. The central tension explored is the conflict between technological capability and creator consent, revolving around legal and ethical dilemmas.
The chapter scrutinizes the ethical implications of this “finders keepers” approach, the use of torrenting to acquire copyrighted material, and the economic imbalance created when AI models compete with the original content creators. Finally, the chapter examines the complex debate surrounding content opt-out mechanisms and concludes by stressing the impending challenge of diminishing data, which will likely force a greater reliance on synthetic data. Ultimately, the chapter argues that the current approach has created a crisis of legitimacy that requires a reevaluation of the terms under which the internet should be scraped.
Ethical considerations in social network studies are grounded in the general principles of human subjects’ research, including avoidance of harm, promotion of justice, equitable distribution of burdens and benefits, respect for human dignity, and protection of confidentiality. To help navigate these challenges, this article presents recommendations for conducting ethical network research, developed by a multi-disciplinary and multi-national working group. The article is divided in three main sections where there are certain recommendations identified for each one of them: data collections, use, and availability. Discovering how others addressed and solved problems can be a way for all of us to improve our capacity to stand up to the scrutiny of ethical governance bodies, while also increasing our capacity to responsibly address novel, rare, or otherwise difficult situations for which institutions provide limited guidance. We see this as a first step toward a virtuous circle, or a form of “generalized indirect reciprocity” whereby researchers share information that may be relevant for others, and benefit at the same time from the information given by other members of the social networks analysis community. Our goal is to continue to produce and promote scientifically solid, ethical social network research.
This paper presents a brief history of archival provenance and its shifting role across different paradigms of archives, considering how this past work can provide insights into current trajectories of AI. It explores what archival provenance does, or can do, differently than current imaginations of data provenance in AI. It proposes three “lessons from archival provenance” that challenge the present focus of existing approaches in AI, in particular highlighting how narrowly this work structures and models evidence, authenticity and creatorship of data. These lessons can be used to identify new opportunities for applying concepts of archival provenance by presenting a roadmap for future work where AI research might align and converge with related work in archival theory. It concludes by asserting that grounding AI datasets in this perspective of archival provenance can realize a new paradigm of “data as archives,” serving to envision responsibilities to a range of data creators, determine needs for documentation of context and establish a crucial role for “data archivists.”
This chapter delves into the narrative aspect of emergency medicine, highlighting the importance of storytelling in patient care and the oral board examination process. It discusses the structured nature of the oral examination, which combines elements of an Observed Structured Clinical Encounter (OSCE) and simulation to evaluate candidates’ clinical skills. The chapter provides insights into the virtual platform used for the exam, the unfolding of cases, and the examiner’s role in guiding the narrative. Strategies for approaching cases, organizing information, and interacting with examiners are detailed, emphasizing the need for efficient data collection and clear communication. Practical tips for exam preparation, including technology setup, time management, and professional conduct, are outlined to help candidates navigate the challenging oral board experience. The structured interview component is also explored, focusing on critical thinking and decision-making processes. Differences between the American Board of Emergency Medicine (ABEM) and the American Osteopathic Board of Emergency Medicine (AOBEM) exams are discussed, with a glimpse into the future transition to an in-person certifying exam by ABEM in 2026.
Exploring the use of our methods has highlighted the importance of defining the boundaries of the system being studied and attending to features of underlying systems that afford causal processes. We note that our limited application of our methods cannot confirm that all the implementation actions were necessary, though our examination of L shows how this might be shown by broader study. We note that, while our methods may seem daunting, they’re no more detailed than statistical methods used in quantitative research and have practical advantages in supplying more detailed qualitative evaluations. They may also be used for ex ante appraisal. We stress the importance of understanding mechanisms in practical research and note that actual research involves back-and-forth between evidence and theories of change, even though we detail the former first in our evaluation. We note the value of such evaluations in combatting problems such as, relevantly, costly failed reforms.
Recruitment for rare disease studies is challenging due to small eligible populations. Traditional clinical research management systems often lack tools to track recruitment contacts prior to enrollment. The NET-PRO study, focused on neuroendocrine tumors (NETs), implemented a participation monitoring system to enhance recruitment efficiency and representativeness.
Methods:
NET-PRO is a multicenter cohort study of 2538 adults diagnosed with gastroenteropancreatic (GEP) or lung NETs between January 2018 and September 2024. Recruitment occurred from January 2022 to February 2025 across 14 U.S. medical centers. Sites used flexible recruitment methods (email, mail, phone, in-clinic) and tracked contacts using REDCap-based tools. Participant characteristics were analyzed by enrollment mode (online or mail) and recruitment difficulty (number of contacts required prior to enrollment) using standardized mean differences, chi-square tests, and ANOVA.
Results:
Of 9279 contacted patients, 2675 consented (28.8%) and 2538 enrolled (27.4%). Most enrolled online (83.2%), while 16.8% enrolled by mail. Mail respondents were older, had lower education and income, and more comorbidities. Among those enrolled, recruitment difficulty was associated with older age, lower education and income, but not comorbidity. Over half of the most difficult-to-recruit participants enrolled online. Contact methods varied by attempt, with email dominating early contacts and phone/mail used more in later attempts.
Conclusions:
A participation monitoring tool supported flexible, multimodal recruitment and improved sample representativeness in a rare cancer study. Tracking recruitment contacts enabled adaptive strategies and may reduce bias in observational research by enabling better outreach to harder-to-reach populations.
This research note introduces a dataset on the career paths of 754 Flemish ministerial advisors (MAs) spanning from 1999 to 2020. The dataset offers comprehensive insights into variables such as gender and age distribution, educational backgrounds, and career trajectories of MAs. To develop this dataset, we employed a suite of software tools designed for data collection, cleaning, and coding. This note details both the tools used and the resulting dataset, while also addressing potential biases and the robustness of the findings. We believe that both the data collection methodology and the dataset itself provide valuable opportunities for further research in elite career studies.
Many archaeological arguments are based on artifact identification, but to be replicable the categories must be well defined, with researchers able to consistently identify the relevant attributes. If data are to be compared across projects or researchers, the same training and reference material should be available. Standardized visual guides for specific artifact types and contexts are valuable tools for improving identification by individuals and reducing inter-operator variation. To standardize shell temper description within Pensacola Mississippian pottery, we describe the development of a visual guide based on replicated shell-tempered pastes. We created 98 unique fired clay briquettes, varying in measured ways across four variables: shell type, particle size, particle density, and whether shell was still present or leached. The resulting briquettes were imaged and arranged for quick comparison with archaeological materials. To test the utility of this guide, we conducted a survey among professional archaeologists, assessing their confidence in and success with identifying shell temper attributes with and without the guide images. The results of the survey demonstrate the effectiveness of such tools for collaborative archaeological research. We describe the general method for producing this type of guide, which may be adapted for different pottery temper types, and provide our own images for use by others studying shell-tempered pottery.
Machine-readable humanity is an evocative idea, and it is this idea which Hanley et al. spell out and critically discuss in their contribution. They are interested in exploring the technological as well as the moral side of the meaning of machine-readability. They start by differentiating between various ways to collect (and read) data and to develop classification schemes. They argue that traditional top-down data collection (first the pegs and then the collection according to the pegs) is less efficient than more recent machine readability, which is dynamic, because of the successive advances of data and predictive analytics (“big data”), machine learning, deep learning, and AI. Discussing the advantages as well as the dangers of this new way to read humans, they conclude that we should be especially cautious vis-à-vis the growing field of digital biomarkers since in the end they could not only endanger privacy and entrench biases, but also obliterate our autonomy. Seen in this light, apps (like AdNauseam) that restrict data collection as a form of protest against behavioral profiling also constitute resistance to the inexorable transformation of humanity into a standing reserve: humans on standby, to be immediately at hand for consumption by digital machines.
Developing therapies for rare diseases is challenging due to limited evidence and high degrees of uncertainty regarding the value of new treatments. Clinical expert judgment can inform modeling assumptions and address areas of uncertainty in reimbursement submissions. As current protocols do not adequately address the challenges faced in rare diseases, this research aimed to generate recommendations for the collection and reporting of clinical expert judgment in rare diseases.
Methods
An international group of industry, payer, and patient experts with a background in rare diseases participated in a roundtable meeting, which aimed to identify practical challenges in and solutions for gathering clinical insights to aid reimbursement decisions for rare disease therapies. Recommendations were cocreated through iterative discussions and group agreement.
Results
Developers should proactively identify uncertainties that expert judgment can address, in parallel with early evidence generation planning. Expert judgment method(s) depend on the uncertainties, with those key to decision-making requiring more robust and time-intensive methods. For highly complex and uncertain topics, methods should facilitate consensus building and expression of diverse views. Given the scarcity of rare disease experts, a high time burden falls on a few experts. Developers should engage diverse stakeholder groups to integrate broader clinical perspectives and reduce reliance on specific individuals while approaching conflicts of interest pragmatically and transparently.
Conclusions
These recommendations create a blueprint for developers of rare disease therapies to conduct high-quality clinical expert judgment studies. Hence, developers can present more robust evidence to inform key areas of uncertainty in reimbursement decisions, where empirical evidence is unavailable.
Chapter 4 considers ethical issues in healthcare communication research through two case studies. The first case study looks at a relatively straightforward situation involving a study of the Pain Concern online forum. Data from the forum was provided by Health Unlocked, a company that runs a large number of online communities related to health. One advantage of using their service was that Health Unlocked took care of relevant legal requirements concerning ethics and only shared data from contributors to the forum who had agreed for their posts to be used for research purposes. The second case study relates to the study of dementia and brings into focus the difficulties of working with multiple datasets and a range of stakeholders. The data collection for this project involved public health communication in terms of news media and external communications from support services, including social media. As such, it presents scenarios that are common to studies of health communication and thereby offers instruction in how to navigate related ethical concerns.
Numerous efforts are focused on building the clinical and translational research (CTR) workforce. Approaches to evaluate CTR initiatives are varied, and efforts often rely on research project-level outcomes. This article applies an evaluation tool to capture individual-level data.
Objective:
The study used a novel Researcher Investment Tool (RIT) to measure researchers’ experience as well as perceptions of institutional support, including an analysis based on researcher characteristics. The study also evaluated the RIT based on common measures, including a bibliometric indicator, investigator status, and percent time dedicated to research.
Methods:
The RIT was administered to researchers who received funding or targeted research support from a CTR initiative. Mean scores were assessed by RIT section, domains/sub-domains, and for each item. Mean scores per section were compared across researcher characteristics using t-tests, and associations between common measures and average domain scores were tested using linear regression.
Results:
Thirty researchers completed all RIT items. RIT domain scores ranged from a high mean of 4.0 for the research skills domain to a low mean of 2.6 for researcher productivity and community engagement domains. Analysis of indicators of commonly used measures across domains suggest that researchers with a higher bibliometric score had more advanced research skills, service to profession, research productivity, and research collaboration (p < .05). New investigators had lower perceptions of institutional support (p < .05).
Conclusions:
As an evaluation tool, the RIT captures individual-level data that may help to determine key areas of strength and opportunities for growth of a CTR program.
This chapter explores the rich landscape of mixed methods research, examining its origins, foundational principles, and essential steps for implementation. You will gain insights into the philosophical underpinnings that shape this approach and learn about the different stages involved in conducting mixed methods research, from planning and data collection to analysis and integration of findings. The chapter discusses various mixed methods research designs, outlining their unique characteristics and applications so that you can discern when and how to utilize each effectively. Additionally, it tackles the integration of data from diverse sources and explores strategies for overcoming the challenges that arise in this process. A critical focus will be on the issue of validity in mixed methods research, where we will highlight essential strategies for ensuring the reliability and credibility of your findings. By the end of this chapter, you will be prepared to address the complexities of mixed methods research and use this versatile approach in your applied linguistics studies.
This paper describes challenges and opportunities for data collection during a disaster, focusing on how young adults in the United States navigated the initial period of the COVID-19 pandemic--a disaster which introduced significant uncertainty and precarity both for individuals and the research process.
Methods
This paper draws on lessons from a small exploratory study which used journaling techniques as a data collection tool.
Results
Journaling addressed 3 key challenges to collecting data during a public health crisis: 1) accessing respondents when preparation time and resources are limited; 2) ensuring protection for both participants and researchers in a context when human interaction is severely constrained; and 3) needing both rapid response and flexibility in research design and data collection.
Conclusions
Journaling techniques are a feasible, efficient and effective tool that can be adapted and utilized in various disaster contexts, including other pandemics and extreme climate events.
Through a series of example research studies, we illustrate processes in translating case report forms to increase language diversity in study populations while simultaneously highlighting implications for data collection and analyses. The Northwestern University Data Analysis and Coordinating Center manages the translation of participant-facing study documents into languages other than English through a process that has been refined over several years, adjusting for changes in technical capabilities in electronic case report forms. This approach to manage, examine for context, and implement certified case report form translations offers an efficient workflow to streamline data capture in multiple languages.
Panel surveys and phone-based data collection are essential for survey research and are often used together due to the practical advantages of conducting repeated interviews over the phone. These tools are particularly critical for research in dynamic or high-risk settings, as highlighted by researchers’ responses to the COVID-19 pandemic. However, preventing high attrition is a major challenge in panel surveys. Current solutions in political science focus on statistical fixes to address attrition ex-post but often overlook a preferable solution: minimizing attrition in the first place. Building on a review of political science panel studies and established best practices, we propose a framework to reduce attrition and introduce an online platform to facilitate the logistics of survey implementation. The web application semi-automates survey call scheduling and enumerator workflows, helping to reduce panel attrition, improve data quality, and minimize enumerator errors. Using this framework in a panel study of Syrian refugees in Lebanon, we maintained participant retention at 63 percent four and a half years after the baseline survey. We provide guidelines for researchers to report panel studies transparently and describe their designs in detail.