Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules

Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	Frontiers in neural circuits Jg. 12; S. 53
Hauptverfasser:	Gerstner, Wulfram, Lehmann, Marco, Liakoni, Vasiliki, Corneil, Dane, Brea, Johanni
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	Switzerland Frontiers Research Foundation 31.07.2018 Frontiers Media S.A
Schlagworte:	Behavioral plasticity Brain - physiology Computer science Dopamine Electrophysiological Phenomena - physiology eligibility trace Experiments hebb rule Humans Learning Learning - physiology Memory Models, Biological Neural networks Neuromodulation neuromodulators Neuronal Plasticity - physiology Neurons - physiology Neuroscience Neurosciences Punishment Reinforcement reinforcement learning surprise Synaptic plasticity synaptic tagging surprise synaptic tagging hebb rule neuromodulators behavioral learning synaptic plasticity eligibility trace reinforcement learning
ISSN:	1662-5110, 1662-5110
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Beschreibung
Zusammenfassung:	Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.
Bibliographie:	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 ObjectType-Review-3 content type line 23 Reviewed by: Blake A. Richards, University of Toronto Scarborough, Canada; Joel Zylberberg, University of Colorado Anschutz Medical Campus, United States Edited by: Edward S. Ruthazer, McGill University, Canada
ISSN:	1662-5110 1662-5110
DOI:	10.3389/fncir.2018.00053