Learning in spiking neural networks by reinforcement of stochastic synaptic transmission

Research output: Contribution to journalArticle

203 Scopus citations

Abstract

It is well-known that chemical synaptic transmission is an unreliable process, but the function of such unreliability remains unclear. Here I consider the hypothesis that the randomness of synaptic transmission is harnessed by the brain for learning, in analogy to the way that genetic mutation is utilized by Darwinian evolution. This is possible if synapses are "hedonistic," responding to a global reward signal by increasing their probabilities of vesicle release or failure, depending on which action immediately preceded reward. Hedonistic synapses learn by computing a stochastic approximation to the gradient of the average reward. They are compatible with synaptic dynamics such as short-term facilitation and depression and with the intricacies of dendritic integration and action potential generation. A network of hedonistic synapses can be trained to perform a desired computation by administering reward appropriately, as illustrated here through numerical simulations of integrate-and-fire model neurons.

Original languageEnglish (US)
Pages (from-to)1063-1073
Number of pages11
JournalNeuron
Volume40
Issue number6
DOIs
StatePublished - Dec 18 2003

All Science Journal Classification (ASJC) codes

  • Neuroscience(all)

Fingerprint Dive into the research topics of 'Learning in spiking neural networks by reinforcement of stochastic synaptic transmission'. Together they form a unique fingerprint.

  • Cite this