Penalized least squares estimation with weakly dependent data

Jianqing Fan, Lei Qi, Xin Tong

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

In statistics and machine learning communities, the last fifteen years have witnessed a surge of high-dimensional models backed by penalized methods and other state-of-the-art variable selection techniques. The high-dimensional models we refer to differ from conventional models in that the number of all parameters p and number of significant parameters s are both allowed to grow with the sample size T. When the field-specific knowledge is preliminary and in view of recent and potential affluence of data from genetics, finance and on-line social networks, etc., such (s, T, p)-triply diverging models enjoy ultimate flexibility in terms of modeling, and they can be used as a data-guided first step of investigation. However, model selection consistency and other theoretical properties were addressed only for independent data, leaving time series largely uncovered. On a simple linear regression model endowed with a weakly dependent sequence, this paper applies a penalized least squares (PLS) approach. Under regularity conditions, we show sign consistency, derive finite sample bound with high probability for estimation error, and prove that PLS estimate is consistent in L2 norm with rate slogs/T.

Original languageEnglish (US)
Pages (from-to)2335-2354
Number of pages20
JournalScience China Mathematics
Volume59
Issue number12
DOIs
StatePublished - Dec 1 2016

All Science Journal Classification (ASJC) codes

  • Mathematics(all)

Keywords

  • high-dimensional model
  • model selection consistency
  • oracle property
  • penalized least squares
  • weakly dependent

Fingerprint Dive into the research topics of 'Penalized least squares estimation with weakly dependent data'. Together they form a unique fingerprint.

Cite this