Weighted averaging and stochastic approximation

I. Jeng Wang, Edwin K P Chong, Sanjeev R. Kulkarni

Research output: Chapter in Book/Report/Conference proceedingChapter

2 Scopus citations

Abstract

We explore the relationship between weighted averaging and stochastic approximation algorithms, and study their convergence via a sample-path analysis. We prove that the convergence of a stochastic approximation algorithm is equivalent to the convergence of the weighted average of the associated noise sequence. We also present necessary and sufficient noise conditions for convergence of the average of the output of a stochastic approximation algorithm in the linear case. We show that the averaged stochastic approximation algorithms can tolerate a larger class of noise sequences than the stand-alone stochastic approximation algorithms.

Original languageEnglish (US)
Title of host publicationProceedings of the IEEE Conference on Decision and Control
Editors Anon
StatePublished - 1996
Externally publishedYes
EventProceedings of the 1996 35th IEEE Conference on Decision and Control. Part 3 (of 4) - Kobe, Jpn
Duration: Dec 11 1996Dec 13 1996

Publication series

NameProceedings of the IEEE Conference on Decision and Control
Volume1
ISSN (Print)0191-2216

Other

OtherProceedings of the 1996 35th IEEE Conference on Decision and Control. Part 3 (of 4)
CityKobe, Jpn
Period12/11/9612/13/96

All Science Journal Classification (ASJC) codes

  • Control and Optimization
  • Control and Systems Engineering
  • Modeling and Simulation

Fingerprint

Dive into the research topics of 'Weighted averaging and stochastic approximation'. Together they form a unique fingerprint.

Cite this