Hostname: page-component-74656f9884-54qdv Total loading time: 0 Render date: 2026-11-10T12:21:28.816Z Has data issue: false hasContentIssue false

Bias Amplification and Bias Unmasking

Published online by Cambridge University Press:  04 January 2017

Joel A. Middleton*
Affiliation:
Department of Political Science, University of California, Berkeley, Barrows Hall, Berkeley, CA 94720, USA
Marc A. Scott
Affiliation:
Department of Humanities and Social Sciences in the Professions, 246 Greene St., New York University, Steinhardt, NY 10003, USA, e-mail: marc.scott@nyu.edu
Ronli Diakow
Affiliation:
New York City Department of Education, 131 Livingston Street, Brooklyn, NY 11201, USA, e-mail: rdiakow@gmail.com
Jennifer L. Hill
Affiliation:
Department of Humanities and Social Sciences in the Professions, 246 Greene St., New York University, Steinhardt, NY 10003, USA, e-mail: jennifer.hill@nyu.edu
*
e-mail: joel.middleton@berkeley.edu (corresponding author)
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

In the analysis of causal effects in non-experimental studies, conditioning on observable covariates is one way to try to reduce unobserved confounder bias. However, a developing literature has shown that conditioning on certain covariates may increase bias, and the mechanisms underlying this phenomenon have not been fully explored. We add to the literature on bias-increasing covariates by first introducing a way to decompose omitted variable bias into three constituent parts: bias due to an unobserved confounder, bias due to excluding observed covariates, and bias due to amplification. This leads to two important findings. Although instruments have been the primary focus of the bias amplification literature to date, we identify the fact that the popular approach of adding group fixed effects can lead to bias amplification as well. This is an important finding because many practitioners think that fixed effects are a convenient way to account for any and all group-level confounding and are at worst harmless. The second finding introduces the concept of bias unmasking and shows how it can be even more insidious than bias amplification in some cases. After introducing these new results analytically, we use constructed observational placebo studies to illustrate bias amplification and bias unmasking with real data. Finally, we propose a way to add bias decomposition information to graphical displays for sensitivity analysis to help practitioners think through the potential for bias amplification and bias unmasking in actual applications.

Information

Type
Articles
Copyright
Copyright © The Author 2016. Published by Oxford University Press on behalf of the Society for Political Methodology 
Supplementary material: PDF

Middleton et al. supplementary material

Supplementary Material

Download Middleton et al. supplementary material(PDF)
PDF 113.7 KB
Supplementary material: File

Middleton et al. supplementary material

Appendix

Download Middleton et al. supplementary material(File)
File 12.5 KB