Abstract
This paper introduces a framework for multivariate regression with attribute-distributed data on a distributed system with a fusion center. Unlike other types of algorithms for attribute-distributed learning that directly refit the ensemble residual or average among the predictions of the agents, the new algorithm, the iterative covariance optimization algorithm (ICOA), coordinates the agents to reshape the covariance matrix of the individual training residuals so that the ensemble estimator, a linear combination of the individual estimators, minimizes the ensemble training error. Moreover, ICOA empirically demonstrates strong insusceptibility to overtraining, especially compared with residual refitting algorithms. Extensive simulations on both artificial and real datasets indicate that ICOA consistently outperforms weighted averaging algorithms and residual refitting algorithms.
Original language | English (US) |
---|---|
Title of host publication | Proceedings of the 2010 American Control Conference, ACC 2010 |
Pages | 6783-6788 |
Number of pages | 6 |
State | Published - Oct 15 2010 |
Event | 2010 American Control Conference, ACC 2010 - Baltimore, MD, United States Duration: Jun 30 2010 → Jul 2 2010 |
Other
Other | 2010 American Control Conference, ACC 2010 |
---|---|
Country/Territory | United States |
City | Baltimore, MD |
Period | 6/30/10 → 7/2/10 |
All Science Journal Classification (ASJC) codes
- Control and Systems Engineering