Field Research Methods

doi:10.1017/9781009170123.010

9 - Field Research Methods

from Part II - Basic Design Considerations to Know, No Matter What Your Research Is About

Published online by Cambridge University Press: 12 December 2024

Sherry Jueyu Wu and

Edited by

Tessa West and

Harry T. Reis: Affiliation:
University of Rochester, New York
Tessa West: Affiliation:
New York University
Charles M. Judd: Affiliation:
University of Colorado Boulder

Book contents

Get access

Summary

Field research refers to research conducted with a high degree of naturalism. The first part of this chapter provides a definition of field research and discusses advantages and limitations. We then provide a brief overview of observational field research methods, followed by an in-depth overview of experimental field research methods. We discuss randomization schemes of different types in field experimentation, such as cluster randomization, block randomization, and randomized rollout or waitlist designs, as well as statistical implementation concerns when conducting field experiments, including spillover, attrition, and noncompliance. The second part of the chapter provides an overview of important considerations when conducting field research. We discuss the psychology of construal in the design of field research, conducting non-WEIRD field research, replicability and generalizability, and how technological advances have impacted field research. We end by discussing career considerations for psychologists who want to get involved in field research.

Keywords

field research field experiments research methodology naturalism research design generalizability causal inference practical guidance

Information

Type: Chapter
Information: Handbook of Research Methods in Social and Personality Psychology , pp. 193 - 218

DOI: https://doi.org/10.1017/9781009170123.010 [Opens in a new window]

Publisher: Cambridge University Press

Print publication year: 2024

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Book purchase

Temporarily unavailable

References

Angrist, J. D., Imbens, G. W., and Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91(434), 444–455.10.1080/01621459.1996.10476902CrossRef Google Scholar

Arnett, J. (2008). The neglected 95%: Why American psychology needs to become less American. American Psychologist, 63, 602–614.10.1037/0003-066X.63.7.602CrossRef Google Scholar PubMed

Aronow, P. M., and Samii, C. (2017). Estimating average causal effects under general interference, with application to a social network experiment. Annals of Applied Statistics, 11, 1912–1947.10.1214/16-AOAS1005CrossRef Google Scholar

Astuti, R., and Bloch, M. (2010). Why a theory of human nature cannot be based on the distinction between universality and variability: Lessons from anthropology. Behavioral and Brain Sciences, 33(2–3), 83–84.10.1017/S0140525X10000026CrossRef Google Scholar

Berger, J., Meredith, M., and Wheeler, S. C. (2008). Contextual priming: Where people vote affects how they vote. Proceedings of the National Academy of Sciences, 105(26), 8846–8849.10.1073/pnas.0711988105CrossRef Google Scholar PubMed

Beshears, J., Dai, H., Milkman, K. L., and Benartzi, S. (2021). Using fresh starts to nudge increased retirement savings. Organizational Behavior and Human Decision Processes, 167, 72–87.10.1016/j.obhdp.2021.06.005CrossRef Google Scholar PubMed

Blair, G., Littman, R., and Paluck, E. L. (2019). Motivating the adoption of new community-minded behaviors: An empirical test in Nigeria. Science Advances, 5(3), eaau5175.10.1126/sciadv.aau5175CrossRef Google Scholar

Blair, G., and McClendon, G. (2021). Conducting experiments in multiple contexts. Advances in Experimental Political Science, 411–428.10.1017/9781108777919.028CrossRef Google Scholar

Blair, G., Weinstein, J. M., Christia, F., Arias, E., Badran, E., Blair, R. A., … Wilke, A. M. (2021). Community policing does not build citizen trust in police or reduce crime in the global South. Science, 374(6571), eabd3446.CrossRef Google Scholar PubMed

Broockman, D., and Kalla, J. (2016). Durably reducing transphobia: A field experiment on door-to-door canvassing. Science, 352(6282), 220–224.10.1126/science.aad9713CrossRef Google Scholar PubMed

Bruner, J. S. (1957). Going beyond the information given. Contemporary Approaches to Cognition, 1, 119–160.Google Scholar

Bullock, J., Green, D., and Ha, S. (2010). Yes, But what’s the mechanism? (Don’t expect an easy answer). Journal of Personality and Social Psychology, 98, 550–558.10.1037/a0018933CrossRef Google Scholar PubMed

Carpenter, S. M., Menictas, M., Nahum-Shani, I., Wetter, D. W., and Murphy, S. A. (2020). Developments in mobile health just-in-time adaptive interventions for addiction science. Current Addiction Reports, 7(3), 280–290.10.1007/s40429-020-00322-yCrossRef Google Scholar PubMed

Chang, E. H., Milkman, K. L., Gromet, D. M., Rebele, R. W., Massey, C., Duckworth, A. L., and Grant, A. M. (2019). The mixed effects of online diversity training. Proceedings of the National Academy of Sciences, 116(16), 7778–7783.10.1073/pnas.1816076116CrossRef Google Scholar PubMed

Cialdini, R. B. (1980). Full-cycle social psychology. Applied Social Psychology Annual, 1, 21–47.Google Scholar

Cialdini, R. B., Demaine, L. J., Sagarin, B. J., Barrett, D. W., Rhoads, K., and Winter, P. L. (2006). Managing social norms for persuasive impact. Social Influence, 1(1), 3–15.10.1080/15534510500181459CrossRef Google Scholar

Dai, H., Saccardo, S., Han, M. A., Roh, L., Raja, N., Vangala, S., Modi, H., Pandya, S., Sloyan, M., and Croymans, D. M. (2021). Behavioural nudges increase COVID-19 vaccinations. Nature, 597(7876), 404–409.10.1038/s41586-021-03843-2CrossRef Google Scholar PubMed

DiNardo, J., McCrary, J., and Sanbonmatsu, L. (2006). Constructive proposals for dealing with attrition: An empirical example. Working paper, University of Michigan.Google Scholar

Dolan, P., and Galizzi, M. M. (2014). Getting policy-makers to listen to field experiments. Oxford Review of Economic Policy, 30(4), 725–752.10.1093/oxrep/gru035CrossRef Google Scholar

Dunning, T. (2016). Transparency, replication, and cumulative learning: What experiments alone cannot achieve. Annual Review of Political Science, 19, 541–563.10.1146/annurev-polisci-042114-015939CrossRef Google Scholar

Ferraro, P. J., and Agrawal, A. (2021). Synthesizing evidence in sustainability science through harmonized experiments: Community monitoring in common pool resources. Proceedings of the National Academy of Sciences, 118(29), e2106489118.10.1073/pnas.2106489118CrossRef Google Scholar PubMed

Gerber, A. S., and Green, D. P. (2000). The effects of canvassing, telephone calls, and direct mail on voter turnout: A field experiment. American Political Science Review, 94(3), 653–663.10.2307/2585837CrossRef Google Scholar

Gerber, A. S., and Green, D. P. (2012). Field Experiments: Design, Analysis, and Interpretation. W. W. Norton & Company.Google Scholar

Gerber, A. S., Huber, G. A., Doherty, D., Dowling, C. M., and Ha, S. E. (2010). Personality and political attitudes: Relationships across issue domains and political contexts. American Political Science Review, 104(1), 111–133.10.1017/S0003055410000031CrossRef Google Scholar

Gneezy, U., and Rustichini, A. (2000). A fine is a price. Journal of Legal Studies, 29(1), 1–17.10.1086/468061CrossRef Google Scholar

Graham, J. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.10.1146/annurev.psych.58.110405.085530CrossRef Google Scholar PubMed

Hansen, P. G., and Jespersen, A. M. (2013). Nudge and the manipulation of choice: A framework for the responsible use of the nudge approach to behaviour change in public policy. European Journal of Risk Regulation, 4(1), 3–28.10.1017/S1867299X00002762CrossRef Google Scholar

Hansen, J. A., and Tummers, L. (2020). A systematic review of field experiments in public administration. Public Administration Review, 80(6), 921–931.10.1111/puar.13181CrossRef Google Scholar

Henrich, J. (2020). The Weirdest People in the World: How the West Became Psychologically Peculiar and Particularly Prosperous. Allen Lane.Google Scholar

Henrich, J., Heine, S. J., and Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33(2–3), 61–83.10.1017/S0140525X0999152XCrossRef Google Scholar PubMed

Hong, L., and Page, S. E. (2004). Groups of diverse problem solvers can outperform groups of high-ability problem solvers. Proceedings of the National Academy of Sciences, 101(46), 16385–16389.CrossRef Google Scholar PubMed

Hudgens, M. G., and Halloran, M. E. (2008). Toward causal inference with interference. Journal of the American Statistical Association, 103(482), 832–842.10.1198/016214508000000292CrossRef Google Scholar PubMed

Hussey, M. A., and Hughes, J. P. (2007). Design and analysis of stepped wedge cluster randomized trials. Contemporary Clinical Trials, 28(2), 182–191.CrossRef Google Scholar PubMed

Inglehart, R., and Welzel, C. (2005). Modernization, Cultural Change, and Democracy: The Human Development Sequence. Cambridge University Press.Google Scholar

International Telecommunication Union. (2021). Facts and Figures 2021: 2.9 Billion People Still Offline (November 2021), www.itu.int/hub/2021/11/facts-and-figures-2021-2-9-billion-people-still-offline/#:~:text=An%20estimated%2037%20per%20cent,still%20never%20used%20the%20Internet.Google Scholar

James, W. (1907). Pragmatism’s conception of truth. The Journal of Philosophy. Psychology and Scientific Methods, 4(6), 141–155.Google Scholar

Kapiszewski, D., MacLean, L. M., and Read, B. L. (2015). Field Research in Political Science: Practices and Principles. Cambridge University Press.10.1017/CBO9780511794551CrossRef Google Scholar

Keep Britain Tidy (2015). How Clean Is England? (December 2015), www.keepbritaintidy.org/sites/default/files/resources/KBT_How_Clean_Is_England_LEQSE_Report_2015.pdf.Google Scholar

King, G., Pan, J., and Roberts, M. (2013). How censorship in China allows government criticism but silences collective expression. American Political Science Review, 107(2), 326–343.10.1017/S0003055413000014CrossRef Google Scholar

Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., AdamsJr, R. B., Alper, S., … Sowden, W. (2018). Many labs 2: Investigating variation in replicability across samples and settings. Advances in Methods and Practices in Psychological Science, 1(4), 443–490.10.1177/2515245918810225CrossRef Google Scholar

Lewin, K. (1944/1997). Problems of research in social psychology. In Lewin, K., Resolving Social Conflicts & Field Theory in Social Science. American Psychological Association.10.1037/10269-000CrossRef Google Scholar

Lewin, K. (1947). Frontiers in group dynamics: II. Channels of group life; social planning and action research. Human Relations, 1(2), 143–153.CrossRef Google Scholar

Liberman, V., Samuels, S. M., and Ross, L. (2004). The name of the game: Predictive power of reputations versus situational labels in determining prisoner’s dilemma game moves. Personality and Social Psychology Bulletin, 30(9), 1175–1185.10.1177/0146167204264004CrossRef Google Scholar PubMed

Marrow, A. J. (1977). The practical theorist: The life and work of Kurt Lewin. Teachers College Press.Google Scholar

Meadon, M., and Spurrett, D. (2010). It’s not just the subjects – there are too many WEIRD researchers. Behavioral and Brain Sciences, 33(2–3), 104–105.10.1017/S0140525X10000208CrossRef Google Scholar

Moore-Berg, S. L., Bernstein, K., Gallardo, R. A., Hameiri, B., Littman, R., O’Neil, S., and Pasek, M. H. (2022). Translating social science for peace: Benefits, challenges, and recommendations. Peace and Conflict: Journal of Peace Psychology, 28(3), 274–283.10.1037/pac0000604CrossRef Google Scholar

Nickerson, D. W. (2008). Is voting contagious? Evidence from two field experiments. American Political Science Review, 102(1), 49–57.10.1017/S0003055408080039CrossRef Google Scholar

Paluck, E. (2009). Reducing intergroup prejudice and conflict using the media: A field experiment in Rwanda. Journal of Personality and Social Psychology, 96, 574–587.10.1037/a0011989CrossRef Google Scholar

Paluck, E. L., and Cialdini, R. B. (2014). Field research methods. In Judd, C. M. and Reis, H. T. (eds.) Handbook of Research Methods in Social and Personality Psychology, 2nd ed. Cambridge University Press.Google Scholar

Paluck, E. L., and Shafir, E. (2017). Chapter 6. The psychology of construal in the design of field experiment revised version, prepared following the NBER Conference on Economics of Field Experiments, organized by Esther Duflo & Abhijit Banerjee. In Banerjee, A. V. and Duflo, E. (eds.) Handbook of Economic Field Experiments, vol. 1. North-Holland.Google Scholar

Pan, J. (2019). How Chinese officials use the Internet to construct their public image. Political Science Research and Methods, 7(2), 197–213.10.1017/psrm.2017.15CrossRef Google Scholar

Center, Pew Research (2021). Internet/broadband fact sheet (April 2021), www.pewresearch.org/internet/fact-sheet/internet-broadband.Google Scholar

Radsch, C. (2009). From cell phones to coffee: Issues of access in Egypt and Lebanon. In Sriram, C. L., King, J. C., Mertus, J. A., Martin-Ortega, O., and Herman, J. (eds.) Surviving field research: working in violent and difficult situations, Abingdon, Oxon.Google Scholar

Read, B. L., Kapiszewski, D., and MacLean, L. M. (eds.). (2015). Field research in political science: Practices and principles. In Kapiszewski, D., MacLean, L. M., and Read, B. L., Field Research in Political Science: Practices and Principles. Cambridge University Press.Google Scholar

Roberts, S. O., Bareket-Shavit, C., Dollins, F. A., Goldie, P. D., and Mortenson, E. (2020). Racial inequality in psychological research: Trends of the past and recommendations for the future. Perspectives on Psychological Science, 15(6), 1295–1309.10.1177/1745691620927709CrossRef Google Scholar PubMed

Ross, L., and Nisbett, R. E. (1991). The person and the situation: Perspectives of social psychology. In Ross, L. and Nisbett, R. E., The Person and the Situation: Perspectives of Social Psychology. McGraw-Hill.Google Scholar

Rozin, P. (2009). What kind of empirical research should we publish, fund, and reward? A different perspective. Perspectives on Psychological Science, 4(4), 435–439.10.1111/j.1745-6924.2009.01151.xCrossRef Google Scholar

Rozin, P. (2010). The weirdest people in the world are a harbinger of the future of the world. Behavioral and Brain Sciences, 33(2–3), 108–109.10.1017/S0140525X10000312CrossRef Google Scholar PubMed

Rubin, D. B. (2001). Using propensity scores to help design observational studies: Application to the tobacco litigation. Health Services and Outcomes Research Methodology, 2(3), 169–188.10.1023/A:1020363010465CrossRef Google Scholar

Rubin, D. B. (2005). Causal inference using potential outcomes. Journal of the American Statistical Association, 100(469), 322–331.10.1198/016214504000001880CrossRef Google Scholar

Ruggeri, K., Većkalov, B., Bojanić, L., Andersen, T. L., Ashcroft-Jones, S., Ayacaxli, N., … Folke, T. (2021). The general fault in our fault lines. Nature Human Behaviour, 5(10), 1369–1380.10.1038/s41562-021-01092-xCrossRef Google Scholar PubMed

Shadish, W. R., Cook, T. D., and Campbell, D. T. (2002). Experimental and Quasi-experimental Designs for Generalized Causal Inference. Houghton Mifflin and Company.Google Scholar

Shafer, K., and Lohse, B. (2005). How to Conduct a Cognitive Interview: A Nutrition Education Example. U.S. Department of Agriculture, National Institute of Food and Agriculture.Google Scholar

Sheely, A. (2013). Second-order devolution and administrative exclusion in the temporary assistance for needy families program. Policy Studies Journal, 41(1), 54–69.10.1111/psj.12002CrossRef Google Scholar

Silver, L. (2019). Smartphone ownership is growing rapidly around the world but not always equally (February 5, 2019). Pew Research Center, www.pewresearch.org/global/2019/02/05/digital-connectivity-growing-rapidly-in-emerging-economies.Google Scholar

Voigt, R., Camp, N. P., Prabhakaran, V., Hamilton, W. L., Hetey, R. C., Griffiths, C. M., Jurgens, D., Jurafsky, D., and Eberhardt, J. L. (2017). Language from police body camera footage shows racial disparities in officer respect. Proceedings of the National Academy of Sciences, 114(25), 6521–6526.10.1073/pnas.1702413114CrossRef Google Scholar PubMed

Walton, G. M., and Cohen, G. L. (2011). A brief social-belonging intervention improves academic and health outcomes of minority students. Science, 331(6023), 1447–1451.10.1126/science.1198364CrossRef Google Scholar PubMed

Willis, G. (2022). Cognitive Interviewing. Sage.Google Scholar

Wood, E. J. (2009). 123 Field Research. In Boix, C. and Stokes, S. C. (eds.) The Oxford Handbook of Comparative Politics. Oxford University Press.Google Scholar

Wu, S. J., Mai, M., Zhuang, M., and Yi, F. (2024). Having a voice in your community: A large-scale field experiment on participatory decision-making in China. Manuscript submitted for publication.Google Scholar

Wu, S. J., and Paluck, E. L. (2020). Participatory practices at work change attitudes and behavior toward societal authority and justice. Nature Communications, 11(1), 2633.CrossRef Google Scholar PubMed

Wu, S. J., and Paluck, E. L. (2021). Designing nudges for the context: Golden coin decals nudge workplace behavior in China. Nudges and Choice Architecture in Organizations, 163, 43–50.Google Scholar

Wu, S. J., and Paluck, E. L. (2022). Having a voice in your group: Increasing productivity through group participation. Behavioural Public Policy, https://doi.org/10.1017/bpp.2022.9.CrossRef Google Scholar

Wu, S. J., Yuhan Mei, B., and Cervantez, J. (2022). Preferences and perceptions of workplace participation: A cross-cultural study. Frontiers in Psychology, 13, 806481.10.3389/fpsyg.2022.806481CrossRef Google Scholar PubMed

Accessibility standard: Unknown

Why this information is here

This section outlines the accessibility features of this content - including support for screen readers, full keyboard navigation and high-contrast display options. This may not be relevant for you.

Accessibility Information

Accessibility compliance for the HTML of this chapter is currently unknown and may be updated in the future.