Local polynomial regression: Optimal kernels and asymptotic minimax efficiency

Jianqing Fan, Theo Gasser, Irène Gijbels, Michael Brockmann, Joachim Engel

Research output: Contribution to journalArticle

51 Scopus citations

Abstract

We consider local polynomial fitting for estimating a regression function and its derivatives nonparametrically. This method possesses many nice features, among which automatic adaptation to the boundary and adaptation to various designs. A first contribution of this paper is the derivation of an optimal kernel for local polynomial regression, revealing that there is a universal optimal weighting scheme. Fan (1993, Ann. Statist., 21, 196-216) showed that the univariate local linear regression estimator is the best linear smoother, meaning that it attains the asymptotic linear minimax risk. Moreover, this smoother has high minimax risk. We show that this property also holds for the multivariate local linear regression estimator. In the univariate case we investigate minimax efficiency of local polynomial regression estimators, and find that the asymptotic minimax efficiency for commonly-used orders of fit is 100% among the class of all linear smoothers. Further, we quantify the loss in efficiency when going beyond this class.

Original languageEnglish (US)
Pages (from-to)79-99
Number of pages21
JournalAnnals of the Institute of Statistical Mathematics
Volume49
Issue number1
DOIs
StatePublished - Jan 1 1997
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Statistics and Probability

Keywords

  • Curve estimation
  • Local polynomials
  • Minimax efficiency
  • Minimax risk
  • Multivariate curve estimation
  • Nonparametric regression
  • Universal optimal weighting scheme

Fingerprint Dive into the research topics of 'Local polynomial regression: Optimal kernels and asymptotic minimax efficiency'. Together they form a unique fingerprint.

  • Cite this