A comparison of recurrent training algorithms for time series analysis and system identification

J. S. Anderson, I. G. Kevrekidis, R. Rico-Martinez

Research output: Contribution to journalReview article

10 Scopus citations

Abstract

Artificial Neural Networks (ANNs) can be used for grey-box or black-box modeling of continuous-time systems by placing them in a framework based on numerical integration techniques. When an implicit integration scheme is used as a template, it imposes a recurrent structure on the overall network. Here we present three algorithms suitable for the training of such "network-plus-integrator" assemblies and compare their relative computational efficiencies. Pineda's Recurrent Back-Propagation (RBP) training method is recast to exploit the structure of the assembly. The second approach is RBP modified to evaluate partial derivatives of network outputs with respect to parameters exactly, while the third is a Newton-Raphson based algorithm in which outputs of the network and partial derivatives are computed at each step instead of approximated. We compare the methods via an illustrative example and discuss aspects of training in a parallel computing environment.

Original languageEnglish (US)
Pages (from-to)S751-S756
JournalComputers and Chemical Engineering
Volume20
Issue numberSUPPL.1
DOIs
StatePublished - Jan 1 1996

All Science Journal Classification (ASJC) codes

  • Chemical Engineering(all)
  • Computer Science Applications

Fingerprint Dive into the research topics of 'A comparison of recurrent training algorithms for time series analysis and system identification'. Together they form a unique fingerprint.

  • Cite this