TY - GEN
T1 - Non-Standard Echo State Networks for Video Door State Monitoring
AU - Steiner, Peter
AU - Jalalvand, Azarakhsh
AU - Birkholz, Peter
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - In recent years, Echo State Networks (ESNs), a special type of Recurrent Neural Networks (RNNs), have become increasingly established in the Machine Learning (ML) community due to their relatively simple initialization and training methods. Traditionally, the input and recurrent weights are generated randomly, with only the output weights being trained, typically using linear regression. However, recent publications have proposed alternative ways to initialize the weight matrices, e.g., by using more deterministic methods or data-driven approaches. This is the first work comparing different simple reservoir structures and an ESN with pre-trained input weights for the task of monitoring the state of a door using a surveillance camera in real-time. The results show that deterministic ESN structures perform better than the randomly initialized baseline, achieving a frame error rate of 2.62% vs. 2.93%.
AB - In recent years, Echo State Networks (ESNs), a special type of Recurrent Neural Networks (RNNs), have become increasingly established in the Machine Learning (ML) community due to their relatively simple initialization and training methods. Traditionally, the input and recurrent weights are generated randomly, with only the output weights being trained, typically using linear regression. However, recent publications have proposed alternative ways to initialize the weight matrices, e.g., by using more deterministic methods or data-driven approaches. This is the first work comparing different simple reservoir structures and an ESN with pre-trained input weights for the task of monitoring the state of a door using a surveillance camera in real-time. The results show that deterministic ESN structures perform better than the randomly initialized baseline, achieving a frame error rate of 2.62% vs. 2.93%.
KW - ESN
KW - RNN
KW - video processing
KW - weight initialization
UR - http://www.scopus.com/inward/record.url?scp=85169542345&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85169542345&partnerID=8YFLogxK
U2 - 10.1109/IJCNN54540.2023.10191096
DO - 10.1109/IJCNN54540.2023.10191096
M3 - Conference contribution
AN - SCOPUS:85169542345
T3 - Proceedings of the International Joint Conference on Neural Networks
BT - IJCNN 2023 - International Joint Conference on Neural Networks, Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2023 International Joint Conference on Neural Networks, IJCNN 2023
Y2 - 18 June 2023 through 23 June 2023
ER -