Hostname: page-component-74656f9884-w5jd6 Total loading time: 0 Render date: 2026-11-04T04:59:21.338Z Has data issue: false hasContentIssue false

Retrieval-Augmented Surveys

Published online by Cambridge University Press:  03 November 2026

Yamil Velez*
Affiliation:
Columbia University , USA
Alec Ewig
Affiliation:
Columbia University , USA
*
Corresponding author: Yamil Velez; E-mail: yrv2004@columbia.edu
Rights & Permissions [Opens in a new window]

Abstract

We introduce retrieval-augmented surveys, a novel survey approach that links respondents’ open-ended priorities to concrete policy proposals in institutional databases, enabling personalized measures of how citizens’ concerns map onto formal agendas. Our pipeline elicits and clarifies each respondent’s top issue concern, summarizes items in a policy database and retrieves semantically relevant candidates (“nearest neighbors”) for inclusion in a respondent-tailored survey. We illustrate the approach with an application to political representation in Congress, evaluating performance across four metrics. First, large majorities of respondents judge the retrieved policy items as mostly or fully addressing their concerns. Second, a hand-coding audit corroborates the alignment of retrieved items with respondent issue stances. Third, support for retrieved items is stable over a short-term panel, with 82% of respondents at the top of the support scale remaining there three weeks later. Fourth, in a tailored conjoint, alignment on the nearest neighbor item has a larger estimated effect on candidate choice than benchmark policies. The framework is modular and portable to other settings, such as rulemaking, municipal agendas, and public budgets, enabling scholars to identify where representation succeeds or fails in the institutional pipeline.

Information

Type
Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2026. Published by Cambridge University Press on behalf of The Society for Political Methodology
Figure 0

Table 1 Examples of open-ended survey responses with corresponding AI-generated tailored ideal issues and top three retrieved nearest neighbor policies from congressional billsTable 1 Long description.

Figure 1

Figure 1 Flowchart of adaptive survey process.Figure 1. long description.

Figure 2

Table 2 Perceptions by item and response category (weighted %)Table 2 long description.

Figure 3

Table 3 Stability of scores across waves for policy types at maximum and above midpoint scoresTable 3 long description.

Figure 4

Figure 2 Example tailored conjoint task. The participant’s nearest neighbor policy concerned homelessness assistance. Attributes vary randomly.Figure 2. long description.

Figure 5

Figure 3 Average marginal component effects (AMCEs) from conjoint analysis. Bars represent 95% confidence intervals.Figure 3. long description.

Figure 6

Table 4 Subgroup differences on representation outcomes.Table 4 long description.

Supplementary material: File

Velez and Ewig supplementary material

Velez and Ewig supplementary material
Download Velez and Ewig supplementary material(File)
File 870.5 KB
Supplementary material: Link

Velez and Ewig Dataset

Link