Logo image
Back
Learning in Feedback-driven Recurrent Spiking Neural Networks using full-FORCE Training
Conference proceeding   Open access

Learning in Feedback-driven Recurrent Spiking Neural Networks using full-FORCE Training

Ankita Paul, Stefan Wagner and Anup Das
Proceedings of ... International Joint Conference on Neural Networks, pp 1-10
01 Jan 2022
DOI: https://doi.org/10.1109/IJCNN55064.2022.9892014
url
https://arxiv.org/pdf/2205.13585View
Open

Abstract

Computer Science, Artificial Intelligence Computer Science, Hardware & Architecture Engineering, Electrical & Electronic Life Sciences & Biomedicine Neurosciences Neurosciences & Neurology Science & Technology Computer Science Engineering Technology
Feedback-driven recurrent spiking neural networks (RSNNs) are powerful computational models that can mimic dynamic systems. However, the presence of a feedback loop from the readout to the recurrent layer de-stabilizes the learning mechanism and prevents it from converging. Here, we propose a supervised training procedure for RSNNs, where a second network is introduced only during the training, to provide hint for the target dynamics. The proposed training procedure consists of generating targets for both recurrent and readout layers (i.e., for a full RSNN system). It uses the recursive least square-based First-Order and Reduced Control Error (FORCE) algorithm to fit the activity of each layer to its target. The proposed full-FORCE training procedure reduces the amount of modifications needed to keep the error between the output and target close to zero. These modifications control the feedback loop, which causes the training to converge. We demonstrate the improved performance and noise robustness of the proposed full-FORCE training procedure to model 8 dynamical systems using RSNNs with leaky integrate and fire (LIF) neurons and rate coding. For energy-efficient hardware implementation, an alternative time-to-first-spike (TTFS) coding is implemented for the full-FORCE training procedure. Compared to rate coding, full-FORCE with TTFS coding generates fewer spikes and facilitates faster convergence to the target dynamics.

Metrics

1 Record Views
8 citations in Web of Science

Details

Logo image