Logistic or linear? Estimating causal effects of experimental treatments on binary outcomes using regression analysis.

Research output: Contribution to journalArticlepeer-review

14 Scopus citations

Abstract

When the outcome is binary, psychologists often use nonlinear modeling strategies such as logit or probit. These strategies are often neither optimal nor justified when the objective is to estimate causal effects of experimental treatments. Researchers need to take extra steps to convert logit and probit coefficients into interpretable quantities, and when they do, these quantities often remain difficult to understand. Odds ratios, for instance, are described as obscure in many textbooks (e.g., Gelman & Hill, 2006, p. 83). I draw on econometric theory and established statistical findings to demonstrate that linear regression is generally the best strategy to estimate causal effects of treatments on binary outcomes. Linear regression coefficients are directly interpretable in terms of probabilities and, when interaction terms or fixed effects are included, linear regression is safer. I review the Neyman-Rubin causal model, which I use to prove analytically that linear regression yields unbiased estimates of treatment effects on binary outcomes. Then, I run simulations and analyze existing data on 24,191 students from 56 middle schools (Paluck, Shepherd, & Aronow, 2013) to illustrate the effectiveness of linear regression. Based on these grounds, I recommend that psychologists use linear regression to estimate treatment effects on binary outcomes. (PsycInfo Database Record (c) 2021 APA, all rights reserved)

Original languageEnglish (US)
Pages (from-to)700-709
Number of pages10
JournalJournal of Experimental Psychology: General
Volume150
Issue number4
DOIs
StatePublished - 2021
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Experimental and Cognitive Psychology
  • Psychology(all)
  • Developmental Neuroscience

Keywords

  • average treatment effects
  • binary outcomes
  • causal effects
  • linear regression
  • logistic regression

Fingerprint

Dive into the research topics of 'Logistic or linear? Estimating causal effects of experimental treatments on binary outcomes using regression analysis.'. Together they form a unique fingerprint.

Cite this