TY - JOUR
T1 - Estimation and Inference on Nonlinear and Heterogeneous Effects
AU - Ratkovic, Marc
AU - Tingley, Dustin
N1 - Funding Information:
We thank Scott de Marchi, Max Gopelrud, Kosuke Imai, Lucas Janson, Shiro Kuriwaki, Lihua Lei, Lisa McKay, Max Farrell, and Brandon Stewart for comments on this article. A previous unpublished article, “The Method of Direct Estimation” (2017), worked toward the approach to point estimates used in this article. On this prior work, we would like to thank Peter Aronow, Scott de Marchi, James Fowler, Andrew Gelman, Max Gopelrud, Kosuke Imai, Gary King, Shiro Kuriwaki, John Londregan, Chris Lucas, Walter Mebane, Rich Nielsen, Molly Roberts, Brandon Stewart, Aaron Strauss, Rocio Titiunik, Tyler VanderWeele, Teppei Yamamoto, Soichiro Yamauchi, and Xiang Zhou, as well as the participants at the Quantitative Social Science Seminar at Princeton, Yale Research Design and Causal Inference seminar, Empirical Implications of Theoretical Models 2018 workshop, and Harvard Applied Statistics workshop.
Publisher Copyright:
© 2023 Southern Political Science Association. All rights reserved.
PY - 2023/4
Y1 - 2023/4
N2 - While multiple regression offers transparency, interpretability, and desirable theoretical properties, the method’s simplicity precludes the discovery of complex heterogeneities in the data. We introduce the Method of Direct Estimation and Inference, which embraces these potential complexities, is interpretable, has desirable theoretical guarantees, and, unlike some existing methods, returns appropriate uncertainty estimates. The proposed method uses a machine learning regression methodology to estimate the observation-level partial effect, or “slope,” of a treatment variable on an outcome and allows this value to vary with background covariates. Importantly, we introduce a robust approach to uncertainty estimates. Specifically, we combine a split sample and conformal strategy to fit a confidence band around the partial effect curve that will contain the true partial effect curve at some controlled proportion of the data, say 90% or 95%, even in the presence of model misspecification. Simulation evidence and an application illustrate the method’s performance.
AB - While multiple regression offers transparency, interpretability, and desirable theoretical properties, the method’s simplicity precludes the discovery of complex heterogeneities in the data. We introduce the Method of Direct Estimation and Inference, which embraces these potential complexities, is interpretable, has desirable theoretical guarantees, and, unlike some existing methods, returns appropriate uncertainty estimates. The proposed method uses a machine learning regression methodology to estimate the observation-level partial effect, or “slope,” of a treatment variable on an outcome and allows this value to vary with background covariates. Importantly, we introduce a robust approach to uncertainty estimates. Specifically, we combine a split sample and conformal strategy to fit a confidence band around the partial effect curve that will contain the true partial effect curve at some controlled proportion of the data, say 90% or 95%, even in the presence of model misspecification. Simulation evidence and an application illustrate the method’s performance.
UR - http://www.scopus.com/inward/record.url?scp=85153776702&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85153776702&partnerID=8YFLogxK
U2 - 10.1086/723811
DO - 10.1086/723811
M3 - Article
AN - SCOPUS:85153776702
SN - 0022-3816
VL - 85
SP - 421
EP - 435
JO - Journal of Politics
JF - Journal of Politics
IS - 2
ER -