Handle with Care: A Sociologist’s Guide to Causal Inference with Instrumental Variables

Chris Felton, Brandon M. Stewart

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Instrumental variables (IV) analysis is a powerful, but fragile, tool for drawing causal inferences from observational data. Sociologists increasingly turn to this strategy in settings where unmeasured confounding between the treatment and outcome is likely. This paper reviews the assumptions required for IV and the consequences of violating them, focusing on sociological applications. We highlight three methodological problems IV faces: (i) identification bias, an asymptotic bias from assumption violations; (ii) estimation bias, a finite-sample bias that persists even when assumptions hold; and (iii) type-M error, the exaggeration of effect size given statistical significance. In each case, we emphasize how weak instruments exacerbate these problems and make results sensitive to minor violations of assumptions. We survey IV papers from top sociology journals, finding that assumptions often go unstated and robust uncertainty measures are rarely used. We provide a practical checklist to show how IV, despite its fragility, can still be useful when handled with care.

Original languageEnglish (US)
JournalSociological Methods and Research
DOIs
StateAccepted/In press - 2024

All Science Journal Classification (ASJC) codes

  • Social Sciences (miscellaneous)
  • Sociology and Political Science

Keywords

  • causal inference
  • instrumental variables
  • quantitative methods
  • robust inference
  • selection on observables
  • sensitivity analysis

Fingerprint

Dive into the research topics of 'Handle with Care: A Sociologist’s Guide to Causal Inference with Instrumental Variables'. Together they form a unique fingerprint.

Cite this