Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules

Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Frontiers in neural circuits Jg. 12; S. 53
Hauptverfasser: Gerstner, Wulfram, Lehmann, Marco, Liakoni, Vasiliki, Corneil, Dane, Brea, Johanni
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Switzerland Frontiers Research Foundation 31.07.2018
Frontiers Media S.A
Schlagworte:
ISSN:1662-5110, 1662-5110
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.
AbstractList Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.
Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.
Author Liakoni, Vasiliki
Lehmann, Marco
Brea, Johanni
Corneil, Dane
Gerstner, Wulfram
AuthorAffiliation School of Computer Science and School of Life Sciences, École Polytechnique Fédérale de Lausanne , Lausanne , Switzerland
AuthorAffiliation_xml – name: School of Computer Science and School of Life Sciences, École Polytechnique Fédérale de Lausanne , Lausanne , Switzerland
Author_xml – sequence: 1
  givenname: Wulfram
  surname: Gerstner
  fullname: Gerstner, Wulfram
– sequence: 2
  givenname: Marco
  surname: Lehmann
  fullname: Lehmann, Marco
– sequence: 3
  givenname: Vasiliki
  surname: Liakoni
  fullname: Liakoni, Vasiliki
– sequence: 4
  givenname: Dane
  surname: Corneil
  fullname: Corneil, Dane
– sequence: 5
  givenname: Johanni
  surname: Brea
  fullname: Brea, Johanni
BackLink https://www.ncbi.nlm.nih.gov/pubmed/30108488$$D View this record in MEDLINE/PubMed
BookMark eNp1Uk1vEzEQXaEi-gF3TsgSFy4J_lqvlwMSVCmtFAGi4WzZ3nHiaGMHe7ei4s_jJC1qK3GyNfPe05uZd1odhRigql4TPGVMtu9dsD5NKSZyijGu2bPqhAhBJzUh-OjB_7g6zXmNsaCi5i-qY4YJllzKk-rPrPdLb3zvh1u0SNpCRjp06Huv8-DtrhoD-gwrfeNj0j1a-A2ga6t7yB_Q7PcWUimEoXSux-02pgFFh75CvARjvA5osUoAkwtth5jQHHQKPizRj7HwX1bPne4zvLp7z6qfF7PF-eVk_u3L1fmn-cTWtRgmxnEjgFNHMKGtJB3vHO1cR0gLNQELHRjJeGM7aHjb1a4VDHeOa1trLBvLzqqrg24X9Vpti2GdblXUXu0LMS2VTmXYHpQTrdNAW8MkcEG0EVoabWomawuMQdH6eNDajmYDnS2jl608En3cCX6llvFGCdy0lPIi8O5OIMVfI-RBbXy20Pc6QByzoljKhgvMZYG-fQJdxzGFsipFaSsIaxuyQ7156OiflfsbF4A4AGyKOSdwqpxVDz7uDPpeEax2YVL7MKldmNQ-TIWInxDvtf9L-Qv0L8_x
CitedBy_id crossref_primary_10_1038_s41467_023_40651_w
crossref_primary_10_1162_neco_a_01452
crossref_primary_10_3389_fncom_2022_1037976
crossref_primary_10_1063_5_0186054
crossref_primary_10_1002_adfm_202213064
crossref_primary_10_3389_fnins_2021_644313
crossref_primary_10_1016_j_jmp_2022_102712
crossref_primary_10_1073_pnas_2318362121
crossref_primary_10_1016_j_neuroscience_2021_12_039
crossref_primary_10_1016_j_neuron_2022_03_026
crossref_primary_10_1038_s41467_022_30827_1
crossref_primary_10_1063_5_0258271
crossref_primary_10_1016_j_neucom_2023_126240
crossref_primary_10_1088_2634_4386_ad05da
crossref_primary_10_1038_s41467_024_47481_4
crossref_primary_10_1038_s41583_023_00742_5
crossref_primary_10_1109_TNNLS_2024_3353571
crossref_primary_10_1177_10738584221108083
crossref_primary_10_1113_JP285566
crossref_primary_10_1371_journal_pcbi_1012030
crossref_primary_10_1016_j_conb_2018_09_007
crossref_primary_10_1073_pnas_2311709121
crossref_primary_10_1109_TNNLS_2022_3153985
crossref_primary_10_3389_fncom_2023_1198128
crossref_primary_10_3389_fnins_2023_1183321
crossref_primary_10_1113_JP285563
crossref_primary_10_1038_s42003_024_06540_8
crossref_primary_10_1109_JETCAS_2020_3032058
crossref_primary_10_1109_TNNLS_2024_3503658
crossref_primary_10_1162_neco_a_01671
crossref_primary_10_1038_s41467_020_15542_z
crossref_primary_10_3389_fnsys_2022_979680
crossref_primary_10_1007_s00422_023_00966_9
crossref_primary_10_1038_s41583_021_00467_3
crossref_primary_10_1016_j_neuron_2019_05_041
crossref_primary_10_1038_s41565_023_01391_6
crossref_primary_10_1038_s41386_022_01374_6
crossref_primary_10_1371_journal_pcbi_1009854
crossref_primary_10_1007_s12559_022_10081_9
crossref_primary_10_1093_cercor_bhab306
crossref_primary_10_1016_j_tins_2021_12_008
crossref_primary_10_1016_j_neunet_2021_09_010
crossref_primary_10_3389_fnint_2023_935177
crossref_primary_10_1371_journal_pcbi_1008360
crossref_primary_10_3389_fpsyg_2023_1160648
crossref_primary_10_1523_JNEUROSCI_0170_24_2024
crossref_primary_10_1371_journal_pone_0313331
crossref_primary_10_1016_j_neuri_2025_100220
crossref_primary_10_1002_adem_202200439
crossref_primary_10_1016_j_biosystems_2022_104825
crossref_primary_10_1016_j_isci_2025_112340
crossref_primary_10_1038_s41467_022_35601_x
crossref_primary_10_1038_s41467_022_33795_8
crossref_primary_10_1038_s41467_025_56345_4
crossref_primary_10_3390_sym13081344
crossref_primary_10_1016_j_neunet_2021_07_033
crossref_primary_10_1371_journal_pcbi_1008078
crossref_primary_10_1109_JPROC_2023_3273520
crossref_primary_10_3389_fncom_2021_640235
crossref_primary_10_1038_s41565_022_01095_3
crossref_primary_10_1371_journal_pone_0316453
crossref_primary_10_1016_j_neuroimage_2021_118780
crossref_primary_10_1038_s41598_021_02779_x
crossref_primary_10_3389_fnbot_2021_629210
crossref_primary_10_1088_1748_0221_18_02_C02060
crossref_primary_10_1038_s41467_023_38570_x
crossref_primary_10_1007_s13534_024_00436_6
crossref_primary_10_1146_annurev_neuro_090919_022842
crossref_primary_10_1038_s41586_024_07311_5
crossref_primary_10_1016_j_neures_2022_12_003
crossref_primary_10_1016_j_neuroscience_2022_01_028
crossref_primary_10_1038_s41598_022_22430_7
crossref_primary_10_1088_2634_4386_ac8828
crossref_primary_10_1371_journal_pcbi_1009070
crossref_primary_10_1038_s41467_022_29727_1
crossref_primary_10_3389_fncom_2023_1053097
crossref_primary_10_3389_fnsys_2018_00044
crossref_primary_10_1038_s41467_023_43432_7
crossref_primary_10_3389_fnbot_2022_904017
crossref_primary_10_1073_pnas_2111821118
crossref_primary_10_3389_fnins_2022_959626
crossref_primary_10_3389_fnbeh_2022_1068271
crossref_primary_10_1038_s41593_024_01671_x
crossref_primary_10_1038_s41467_022_29870_9
crossref_primary_10_1109_TNNLS_2025_3527700
crossref_primary_10_1371_journal_pcbi_1011139
crossref_primary_10_3389_fncom_2019_00018
crossref_primary_10_1017_S0140525X23003424
crossref_primary_10_1021_acs_chemrev_4c00670
crossref_primary_10_3389_fmats_2024_1356610
crossref_primary_10_3389_frobt_2024_1435197
crossref_primary_10_7554_eLife_43299
crossref_primary_10_1038_s41467_021_27653_2
crossref_primary_10_1016_j_neuron_2022_09_008
crossref_primary_10_1109_ACCESS_2025_3582564
crossref_primary_10_1088_2634_4386_ac4a83
crossref_primary_10_1088_2634_4386_ad6733
crossref_primary_10_1088_2634_4386_ac4918
crossref_primary_10_1162_neco_a_01352
crossref_primary_10_1016_j_neunet_2022_03_021
crossref_primary_10_3389_fnins_2023_1149410
crossref_primary_10_1109_TNNLS_2024_3352653
crossref_primary_10_1111_ejn_14408
crossref_primary_10_7554_eLife_73046
crossref_primary_10_1073_pnas_2312992121
crossref_primary_10_3389_fncom_2022_954847
crossref_primary_10_1038_s41583_019_0200_y
crossref_primary_10_1038_s41593_021_00857_x
crossref_primary_10_1016_j_neucom_2023_126740
crossref_primary_10_1088_1748_3190_ac9ffc
crossref_primary_10_1038_s41467_024_50205_3
crossref_primary_10_3389_fnins_2023_1248936
crossref_primary_10_1109_JPROC_2020_3045625
crossref_primary_10_1038_s42003_024_06203_8
crossref_primary_10_1038_s41598_019_52781_7
crossref_primary_10_1371_journal_pcbi_1011844
crossref_primary_10_1038_s41467_020_17236_y
crossref_primary_10_7554_eLife_47463
crossref_primary_10_1523_JNEUROSCI_1950_21_2022
crossref_primary_10_3758_s13420_023_00591_3
crossref_primary_10_1016_j_pneurobio_2020_101881
crossref_primary_10_1038_s41598_020_75820_0
crossref_primary_10_1016_j_cub_2025_02_007
crossref_primary_10_1063_5_0157645
crossref_primary_10_1587_nolta_16_64
crossref_primary_10_1038_s41598_022_05637_6
crossref_primary_10_1109_TETCI_2022_3174905
crossref_primary_10_1038_s42256_024_00845_3
crossref_primary_10_1016_j_cub_2024_05_008
crossref_primary_10_3389_fncir_2022_836930
crossref_primary_10_1016_j_cobeha_2021_07_005
crossref_primary_10_1016_j_neuroimage_2023_120458
crossref_primary_10_1371_journal_pcbi_1011839
crossref_primary_10_1016_j_eswa_2024_126373
crossref_primary_10_1016_j_neuron_2022_12_034
crossref_primary_10_3389_fncom_2018_00049
crossref_primary_10_3390_s24196419
crossref_primary_10_1002_adma_202107754
crossref_primary_10_7554_eLife_81071
Cites_doi 10.1016/j.tins.2013.03.003
10.1115/1.3662552
10.1038/222960a0
10.1038/nn.2479
10.1038/nrn.2018.6
10.1152/jn.00803.2004
10.1126/science.1123513
10.1146/annurev.neuro.23.1.649
10.1162/neco.2007.19.6.1468
10.1371/journal.pcbi.1005260
10.1038/nrn2963
10.1002/(SICI)1098-1063(2000)10:1<1::AID-HIPO1>3.0.CO;2-1
10.1073/pnas.0900546106
10.1523/JNEUROSCI.6249-09.2010
10.7554/eLife.22901
10.1371/journal.pcbi.1000586
10.1016/j.visres.2008.09.007
10.1523/JNEUROSCI.3989-14.2015
10.3389/fncir.2015.00085
10.1038/416433a
10.1016/j.tins.2011.07.006
10.1523/JNEUROSCI.02-01-00032.1982
10.3389/neuro.10.007.2008
10.1111/ejn.13921
10.1016/j.neuron.2005.02.001
10.1371/journal.pcbi.1000248
10.1093/cercor/bhl152
10.1080/09540090600768658
10.1016/j.neuron.2012.03.037
10.1103/PhysRevE.69.041909
10.1073/pnas.152343099
10.1007/BF00992696
10.3389/fnhum.2014.00825
10.1126/science.1150769
10.1007/978-3-642-22887-2_5
10.1152/jn.1992.67.1.145
10.7554/eLife.21886
10.1038/35036191
10.1016/0306-4522(83)90010-6
10.1016/0006-8993(85)91418-0
10.1523/JNEUROSCI.0271-06.2006
10.1523/JNEUROSCI.20-07-02451.2000
10.1002/j.1538-7305.1948.tb01338.x
10.1103/PhysRevE.59.4498
10.7554/eLife.09685
10.1038/nrn2558
10.1016/j.conb.2006.09.002
10.1371/journal.pcbi.1000180
10.1073/pnas.82.9.3055
10.1162/089976600300015961
10.1371/journal.pcbi.1004031
10.1016/0166-2236(93)90081-V
10.1371/journal.pcbi.1005003
10.1162/089976602760407955
10.1016/j.neuron.2015.09.037
10.1126/science.275.5306.1593
10.1016/j.neuron.2005.04.026
10.1152/jn.1998.80.1.1
10.1113/jphysiol.1952.sp004764
10.1016/S0306-4522(98)00697-6
10.1038/385533a0
10.1038/nn.4401
10.1126/science.1372754
10.1007/s004220000171
10.1523/JNEUROSCI.4098-12.2013
10.1523/JNEUROSCI.20-23-08812.2000
10.1126/science.132.3423.349
10.1126/science.1255514
10.1016/j.neuron.2013.11.030
10.1073/pnas.79.8.2554
10.1038/nature10776
10.1016/j.neubiorev.2016.06.022
10.1038/scientificamerican0992-60
10.1126/science.1091277
10.1371/journal.pcbi.0030221
10.1126/science.aan3846
10.1016/S0896-6273(02)00967-4
10.1073/pnas.1105933108
10.1016/j.neuropharm.2006.07.026
10.1038/35087601
10.1038/nrn2787
10.1038/312101a0
10.1038/219736a0
10.1109/TAMD.2010.2056368
10.1038/nn736
10.1038/nature19325
10.1016/j.neuroimage.2014.11.007
10.3389/fnsyn.2010.00146
10.1162/neco_a_01025
10.1162/neco.2006.18.6.1318
10.1162/neco.2007.19.11.2881
10.3389/fnhum.2011.00039
10.1073/pnas.0505220103
10.1016/S0893-6080(02)00045-X
10.1103/PhysRevLett.86.364
10.1038/nrn2022
10.1038/25665
10.1162/0899766054615699
10.1126/science.959831
10.1016/j.neuron.2009.07.018
10.1371/journal.pcbi.1004060
10.1371/journal.pcbi.1002689
10.1016/S0301-0082(96)00042-1
10.7554/eLife.27756
10.1038/nn1560
10.1098/rstb.2002.1242
10.1901/jeab.2009.91-377
10.1016/j.conb.2015.12.010
10.1007/BF00114726
10.1093/cercor/bhx339
10.1146/annurev.neuro.23.1.473
10.1038/ncomms13276
10.1002/hipo.450050304
10.1016/S0306-4522(02)00026-X
10.1109/TEVC.2006.890271
10.1016/j.neuron.2013.10.025
10.1523/JNEUROSCI.1083-07.2007
10.1371/journal.pcbi.1000259
10.1038/383076a0
10.1371/journal.pcbi.1003024
10.1073/pnas.86.23.9574
10.1007/BF00275687
10.1162/089976601300014628
10.3389/fnhum.2012.00359
10.1038/361031a0
10.3389/fncir.2013.00037
10.1016/S0896-6273(01)00542-6
10.1162/089976603321891783
10.1016/S0959-4388(00)00153-7
10.1523/JNEUROSCI.3886-12.2013
10.1016/j.neuron.2015.05.037
10.3389/fncom.2014.00038
10.1098/rstb.2016.0260
10.1523/JNEUROSCI.0822-10.2010
10.1038/nn.4062
10.1038/nn.2264
10.1016/S0165-0173(99)00040-5
10.1016/j.tics.2009.11.005
10.1016/j.neuron.2014.03.021
10.1126/science.275.5297.213
10.1038/78829
10.1162/neco.1994.6.1.100
10.1037/0033-295X.88.2.135
ContentType Journal Article
Copyright 2018. This work is licensed under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright © 2018 Gerstner, Lehmann, Liakoni, Corneil and Brea. 2018 Gerstner, Lehmann, Liakoni, Corneil and Brea
Copyright_xml – notice: 2018. This work is licensed under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
– notice: Copyright © 2018 Gerstner, Lehmann, Liakoni, Corneil and Brea. 2018 Gerstner, Lehmann, Liakoni, Corneil and Brea
DBID AAYXX
CITATION
CGR
CUY
CVF
ECM
EIF
NPM
3V.
7XB
88I
8FE
8FH
8FK
ABUWG
AFKRA
AZQEC
BBNVY
BENPR
BHPHI
CCPQU
DWQXO
GNUQQ
HCIFZ
LK8
M2P
M7P
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
Q9U
7X8
5PM
DOA
DOI 10.3389/fncir.2018.00053
DatabaseName CrossRef
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
ProQuest Central (Corporate)
ProQuest Central (purchase pre-March 2016)
Science Database (Alumni Edition)
ProQuest SciTech Collection
ProQuest Natural Science Collection
ProQuest Central (Alumni) (purchase pre-March 2016)
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
ProQuest Central Essentials - QC
Biological Science Collection
ProQuest Central
Natural Science Collection
ProQuest One
ProQuest Central
ProQuest Central Student
SciTech Premium Collection
Biological Sciences
Science Database
Biological Science Database
ProQuest Central Premium
ProQuest One Academic
Publicly Available Content Database (ProQuest)
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
One Applied & Life Sciences
ProQuest One Academic (retired)
ProQuest One Academic UKI Edition
ProQuest Central China
ProQuest Central Basic
MEDLINE - Academic
PubMed Central (Full Participant titles)
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
Publicly Available Content Database
ProQuest Central Student
ProQuest One Academic Middle East (New)
ProQuest Central Essentials
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Natural Science Collection
ProQuest Central China
ProQuest Central
ProQuest One Applied & Life Sciences
Natural Science Collection
ProQuest Central Korea
Biological Science Collection
ProQuest Central (New)
ProQuest Science Journals (Alumni Edition)
ProQuest Biological Science Collection
ProQuest Central Basic
ProQuest Science Journals
ProQuest One Academic Eastern Edition
Biological Science Database
ProQuest SciTech Collection
ProQuest One Academic UKI Edition
ProQuest One Academic
ProQuest One Academic (New)
ProQuest Central (Alumni)
MEDLINE - Academic
DatabaseTitleList Publicly Available Content Database

MEDLINE - Academic

MEDLINE
Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: NPM
  name: PubMed
  url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 3
  dbid: PIMPY
  name: Publicly Available Content Database
  url: http://search.proquest.com/publiccontent
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Anatomy & Physiology
Computer Science
EISSN 1662-5110
ExternalDocumentID oai_doaj_org_article_f69fae29b38e461ab6a8bab5385ce33e
PMC6079224
30108488
10_3389_fncir_2018_00053
Genre Research Support, Non-U.S. Gov't
Journal Article
Review
GrantInformation_xml – fundername: European Research Council
  grantid: 268689
– fundername: Horizon 2020
  grantid: 720270
– fundername: Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
  grantid: 200020 165538
GroupedDBID ---
29H
2WC
53G
5GY
5VS
88I
8FE
8FH
9T4
AAFWJ
AAYXX
ABUWG
ACGFS
ADBBV
ADRAZ
AEGXH
AENEX
AFFHD
AFKRA
AFPKN
ALMA_UNASSIGNED_HOLDINGS
AOIJS
AZQEC
BAWUL
BBNVY
BCNDV
BENPR
BHPHI
BPHCQ
CCPQU
CITATION
CS3
DIK
DU5
DWQXO
E3Z
EMOBN
F5P
GNUQQ
GROUPED_DOAJ
GX1
HCIFZ
HYE
INR
KQ8
LK8
M2P
M48
M7P
M~E
O5R
O5S
OK1
OVT
PGMZT
PHGZM
PHGZT
PIMPY
PQGLB
PQQKQ
PROAC
RNS
RPM
TR2
ACXDI
C1A
CGR
CUY
CVF
ECM
EIF
IPNFZ
NPM
RIG
3V.
7XB
8FK
PKEHL
PQEST
PQUKI
PRINS
Q9U
7X8
5PM
ID FETCH-LOGICAL-c556t-bf4b6e42f1012981d4df2dfd119e51ecedeb8347cde749d5f9630df4ac5a087c3
IEDL.DBID BENPR
ISICitedReferencesCount 191
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000440325400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1662-5110
IngestDate Mon Nov 10 04:31:50 EST 2025
Tue Nov 04 02:02:53 EST 2025
Sun Nov 09 10:51:01 EST 2025
Fri Jul 25 11:40:43 EDT 2025
Mon Jul 21 05:58:10 EDT 2025
Sat Nov 29 02:24:32 EST 2025
Tue Nov 18 22:04:50 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Keywords surprise
synaptic tagging
hebb rule
neuromodulators
behavioral learning
synaptic plasticity
eligibility trace
reinforcement learning
Language English
License This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c556t-bf4b6e42f1012981d4df2dfd119e51ecedeb8347cde749d5f9630df4ac5a087c3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ObjectType-Review-3
content type line 23
Reviewed by: Blake A. Richards, University of Toronto Scarborough, Canada; Joel Zylberberg, University of Colorado Anschutz Medical Campus, United States
Edited by: Edward S. Ruthazer, McGill University, Canada
OpenAccessLink https://www.proquest.com/docview/2296139718?pq-origsite=%requestingapplication%
PMID 30108488
PQID 2296139718
PQPubID 4424406
ParticipantIDs doaj_primary_oai_doaj_org_article_f69fae29b38e461ab6a8bab5385ce33e
pubmedcentral_primary_oai_pubmedcentral_nih_gov_6079224
proquest_miscellaneous_2088746048
proquest_journals_2296139718
pubmed_primary_30108488
crossref_citationtrail_10_3389_fncir_2018_00053
crossref_primary_10_3389_fncir_2018_00053
PublicationCentury 2000
PublicationDate 2018-07-31
PublicationDateYYYYMMDD 2018-07-31
PublicationDate_xml – month: 07
  year: 2018
  text: 2018-07-31
  day: 31
PublicationDecade 2010
PublicationPlace Switzerland
PublicationPlace_xml – name: Switzerland
– name: Lausanne
PublicationTitle Frontiers in neural circuits
PublicationTitleAlternate Front Neural Circuits
PublicationYear 2018
Publisher Frontiers Research Foundation
Frontiers Media S.A
Publisher_xml – name: Frontiers Research Foundation
– name: Frontiers Media S.A
References Suri (B140) 1999; 91
Ljunberg (B79) 1992; 67
Mathys (B86) 2014; 8
Little (B78) 2013; 7
Greensmith (B49) 2004; 5
Sun (B139) 2011
Barto (B6) 1985; 4
Buonomano (B22) 2009; 10
Mnih (B93) 2016
Singh (B134) 1996; 22
Urbanczik (B148) 2014; 81
Artola (B2) 1993; 16
Hess (B57) 1960; 132
Roeper (B114) 2013; 36
Bittner (B11) 2017; 357
Sutton (B143) 2018
Sutton (B142) 1998
Brzosko (B20) 2015
Fusi (B45) 2005; 45
Pavlov (B102) 1927
van Rossum (B149) 2000; 20
Reymann (B108) 2007; 52
Gu (B50) 2002; 111
Hodgkin (B58) 1952; 117
Daw (B28) 2005; 8
Schmidhuber (B119) 2006; 18
Itti (B61) 2009; 49
Gjorjieva (B47) 2011; 108
Meyniel (B89) 2016; 12
Maass (B82) 2002; 14
Redondo (B107) 2011; 12
Benna (B8) 2016; 19
Susillo (B141) 2009; 63
Zhang (B157) 2009; 106
Thorndike (B146) 1911
Schultz (B122) 1998; 80
Mathys (B85) 2011; 5
Singh (B133) 2004; 17
Nassar (B96) 2010; 30
Roelfsema (B111) 2018; 19
Mongillo (B95) 2008; 319
Wang (B151) 2016; 37
Guerguiev (B51) 2017
Shatz (B129) 1992; 267
Fauth (B34) 2015; 11
Barto (B7) 1983; 13
Bartlett (B5) 1999
Okouchi (B100) 2009; 91
Moncada (B94) 2007; 27
Schultz (B123) 2002; 36
Lisman (B77) 2011; 34
Pawlak (B103) 2010; 2
Doya (B32); 12
Gerstner (B46) 1996; 383
Florian (B36) 2007; 19
Urbanczik (B147) 2009; 12
Oja (B98) 1982; 15
Brea (B18) 2013; 33
Froemke (B44) 2002; 416
Rubin (B117) 2001; 86
Ziegler (B159) 2015; 35
Oudeyer (B101) 2007; 11
Shuler (B132) 2006; 311
Song (B136) 2000; 3
Graupner (B48) 2007; 3
Senn (B126) 2001; 13
Schultz (B125) 2000; 23
Shindou (B130) 2018
Xie (B154) 2004; 69
Yagishita (B155) 2014; 345
Kolossa (B69) 2015; 106
Lisman (B73) 1985; 82
Rezende (B110) 2014; 8
Helias (B56) 2008; 2
Schultz (B124) 1997; 275
Deger (B29) 2012; 8
Schmidhuber (B118) 1991
Hopfield (B59) 1982; 79
Haber (B52) 2006; 26
Lisman (B74) 1989; 86
Storck (B138) 1995
Bittner (B10) 2015; 357
Brader (B16) 2007; 19
Willshaw (B153) 1969; 222
Frémaux (B40) 2013; 9
Bienenstock (B9) 1982; 2
Clopath (B25) 2008; 4
Frémaux (B38) 2016; 9
Ngezahayo (B97) 2000; 20
Frey (B41) 1997; 385
Takeuchi (B145) 2016; 537
Clopath (B24) 2010; 13
Menegas (B88) 2017
Bliss (B14) 1993; 361
Lisman (B75) 2003; 358
Foster (B37) 2000; 10
Klopf (B67) 1972; 133
Brea (B17) 2016; 12
Kalman (B65) 1960; 82
O'Keefe (B99) 1978
Miller (B91) 1994; 6
Crick (B26) 1984; 312
Markram (B83) 1997; 275
Brown (B19) 1995; 5
Martin (B84) 2000; 23
Izhikevich (B62) 2007; 17
Squires (B137) 1976; 193
Bliss (B12) 1973; 232
Frémaux (B39) 2010; 40
Middleton (B90) 2000; 31
Friston (B43) 2016; 68
Seo (B127) 2012; 74
Redgrave (B106) 2006; 7
Levy (B71) 1983; 8
Sutton (B144) 1981; 88
Vasilaki (B150) 2009; 5
Crow (B27) 1968; 219
Rubin (B116) 2005; 93
Fiorillo (B35) 2013; 33
Izhikevich (B63) 2003; 15
Jaeger (B64) 2004; 304
Lillicrap (B72) 2016; 7
Poort (B105) 2015; 86
Bosch (B15) 2014; 82
Pfister (B104) 2006; 18
Rombouts (B115) 2015; 11
Yu (B156) 2005; 46
Reynolds (B109) 2002; 15
Shannon (B128) 1948; 27
Faraji (B33) 2018; 30
Arleo (B1) 2000; 83
Brzosko (B21) 2017
Barrett (B4) 2009; 5
Williams (B152) 1992; 8
Loewenstein (B80) 2006; 103
Friston (B42) 2010; 11
Schmidhuber (B120) 2010; 2
Huganir (B60) 2013; 80
Hebb (B55) 1949
Kempter (B66) 1999; 59
Matsuzaki (B87) 2001; 4
Mink (B92) 1996; 50
Löwel (B81) 1992; 255
Sjöström (B135) 2001; 32
Roelfsema (B113) 2010; 14
Schoups (B121) 2001; 412
Hasselmo (B53) 2006; 16
Lisman (B76) 2017; 372
He (B54) 2015; 88
Cassenaer (B23) 2012; 482
Shouval (B131) 2002; 99
Deger (B30) 2018; 28
Legenstein (B70) 2008; 4
Kolossa (B68) 2013; 6
Zhang (B158) 1998; 395
Roelfsema (B112) 2005; 17
Doya (B31); 10
Bailey (B3) 2000; 1
Black (B13) 1985; 359
References_xml – volume: 36
  start-page: 336
  year: 2013
  ident: B114
  article-title: Dissecting the diversity of midbrain dopamine neurons
  publication-title: Trends Neurosci.
  doi: 10.1016/j.tins.2013.03.003
– volume: 82
  start-page: 35
  year: 1960
  ident: B65
  article-title: A new approach to linear filtering and prediction problems
  publication-title: J. Basic Eng.
  doi: 10.1115/1.3662552
– volume: 222
  start-page: 960
  year: 1969
  ident: B153
  article-title: Non-holographic associative memory
  publication-title: Nature
  doi: 10.1038/222960a0
– volume: 13
  start-page: 344
  year: 2010
  ident: B24
  article-title: Connectivity reflects coding: a model of voltage-based spike-timing-dependent-plasticity with homeostasis
  publication-title: Nat. Neurosci.
  doi: 10.1038/nn.2479
– volume: 19
  start-page: 166
  year: 2018
  ident: B111
  article-title: Control of synaptic plasticity in deep cortical networks
  publication-title: Nat. Rev. Neurosci.
  doi: 10.1038/nrn.2018.6
– volume: 93
  start-page: 2600
  year: 2005
  ident: B116
  article-title: Calcium time course as a signal for spike-timing-dependent plasticity
  publication-title: J. Neurophysiol.
  doi: 10.1152/jn.00803.2004
– volume: 311
  start-page: 1606
  year: 2006
  ident: B132
  article-title: Reward timing in the primary visual cortex
  publication-title: Science
  doi: 10.1126/science.1123513
– volume: 23
  start-page: 649
  year: 2000
  ident: B84
  article-title: Synaptic plasticity and memory: an evaluation of the hypothesis
  publication-title: Ann. Rev. Neurosci.
  doi: 10.1146/annurev.neuro.23.1.649
– volume: 19
  start-page: 1468
  year: 2007
  ident: B36
  article-title: Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity
  publication-title: Neural Comput.
  doi: 10.1162/neco.2007.19.6.1468
– volume: 12
  start-page: e1005260
  year: 2016
  ident: B89
  article-title: Human inferences about sequences: a minimal transition probability model
  publication-title: PLoS Comput. Biol.
  doi: 10.1371/journal.pcbi.1005260
– start-page: 159
  volume-title: Proceedings of ICANN'95
  year: 1995
  ident: B138
  article-title: Reinforcement-driven information acquisition in non-deterministic environments
– volume: 12
  start-page: 17
  year: 2011
  ident: B107
  article-title: Making memories last: the synaptic tagging and capture hypothesis
  publication-title: Nat. Rev. Neurosci.
  doi: 10.1038/nrn2963
– volume: 10
  start-page: 1
  year: 2000
  ident: B37
  article-title: Models of hippocampally dependent navigation using the temporal difference learning rule
  publication-title: Hippocampus
  doi: 10.1002/(SICI)1098-1063(2000)10:1<1::AID-HIPO1>3.0.CO;2-1
– volume: 106
  start-page: 13028
  year: 2009
  ident: B157
  article-title: Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses
  publication-title: Proc. Natl. Acad. Sci. U.S.A.
  doi: 10.1073/pnas.0900546106
– volume: 40
  start-page: 13326
  year: 2010
  ident: B39
  article-title: Functional requirements for reward-modulated spike-timing-dependent plasticity
  publication-title: J. Neurosci.
  doi: 10.1523/JNEUROSCI.6249-09.2010
– year: 2017
  ident: B51
  article-title: Towards deep learning with segregated dendrites
  publication-title: elife
  doi: 10.7554/eLife.22901
– volume: 5
  start-page: e1000586
  year: 2009
  ident: B150
  article-title: Spike-based reinforcement learning in continuous state and action space: When policy gradient methods fail
  publication-title: PLoS Comput.Biol.
  doi: 10.1371/journal.pcbi.1000586
– volume: 49
  start-page: 1295
  year: 2009
  ident: B61
  article-title: Bayesian surprise attracts human attention
  publication-title: Vis. Res.
  doi: 10.1016/j.visres.2008.09.007
– volume: 35
  start-page: 1319
  year: 2015
  ident: B159
  article-title: Synaptic consolidation: from synapses to behavioral modeling
  publication-title: J. Neurosci.
  doi: 10.1523/JNEUROSCI.3989-14.2015
– volume: 9
  start-page: 85
  year: 2016
  ident: B38
  article-title: Neuromodulated spike-timing dependent plasticity and theory of three-factor learning rules
  publication-title: Front. Neural Circ.
  doi: 10.3389/fncir.2015.00085
– volume: 416
  start-page: 433
  year: 2002
  ident: B44
  article-title: Spike-timing dependent plasticity induced by natural spike trains
  publication-title: Nature
  doi: 10.1038/416433a
– volume: 34
  start-page: 536
  year: 2011
  ident: B77
  article-title: A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP
  publication-title: Trends Neurosci.
  doi: 10.1016/j.tins.2011.07.006
– volume: 2
  start-page: 32
  year: 1982
  ident: B9
  article-title: Theory of the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex
  publication-title: J. Neurosci.
  doi: 10.1523/JNEUROSCI.02-01-00032.1982
– volume: 2
  start-page: 7
  year: 2008
  ident: B56
  article-title: Structural plasticity controlled by calcium based correlation detection
  publication-title: Front. Comput. Neurosci.
  doi: 10.3389/neuro.10.007.2008
– year: 2018
  ident: B130
  article-title: A silent eligibility trace enables dopamine-dependent synaptic plasticity for reinforcement learning in the mouse striatum
  publication-title: Eur. J. Neurosci.
  doi: 10.1111/ejn.13921
– volume: 45
  start-page: 599
  year: 2005
  ident: B45
  article-title: Cascade models of synaptically stored memories
  publication-title: Neuron
  doi: 10.1016/j.neuron.2005.02.001
– volume: 17
  start-page: 1281
  year: 2004
  ident: B133
  article-title: Intrinsically motivated reinforcement learning
  publication-title: Adv. Neural Inform. Proc. Syst.
– volume: 4
  start-page: e1000248
  year: 2008
  ident: B25
  article-title: Tag-trigger-consolidation: a model of early and late long-term-potentiation and depression
  publication-title: PLoS Comput. Biol.
  doi: 10.1371/journal.pcbi.1000248
– volume: 17
  start-page: 2443
  year: 2007
  ident: B62
  article-title: Solving the distal reward problem through linkage of STDP and dopamine signaling
  publication-title: Cereb. Cortex
  doi: 10.1093/cercor/bhl152
– volume: 18
  start-page: 173
  year: 2006
  ident: B119
  article-title: Developmental robotics, optimal artificial curiosity, creativity, music, and the fine arts
  publication-title: Connect. Sci.
  doi: 10.1080/09540090600768658
– volume: 74
  start-page: 947
  year: 2012
  ident: B127
  article-title: Action selection and action value in frontal-striatal circuits
  publication-title: Neuron
  doi: 10.1016/j.neuron.2012.03.037
– volume: 69
  start-page: 41909
  year: 2004
  ident: B154
  article-title: Learning in neural networks by reinforcement of irregular spiking
  publication-title: Phys. Rev. E
  doi: 10.1103/PhysRevE.69.041909
– volume: 99
  start-page: 10831
  year: 2002
  ident: B131
  article-title: A unified model of NMDA receptor dependent bidirectional synaptic plasticity
  publication-title: Proc. Natl. Acad. Sci. U.S.A.
  doi: 10.1073/pnas.152343099
– volume: 13
  start-page: 835
  year: 1983
  ident: B7
  article-title: Neuronlike adaptive elements that can solve difficult learning and control problems
  publication-title: IEEE Trans. Syst. Man Cybern.
– volume: 8
  start-page: 229
  year: 1992
  ident: B152
  article-title: Simple statistical gradient-following methods for connectionist reinforcement learning
  publication-title: Mach. Learn.
  doi: 10.1007/BF00992696
– volume: 8
  start-page: 825
  year: 2014
  ident: B86
  article-title: Uncertainty in perception and the hierarchical gaussian filter
  publication-title: Front. Hum. Neurosci.
  doi: 10.3389/fnhum.2014.00825
– volume: 319
  start-page: 1543
  year: 2008
  ident: B95
  article-title: Synaptic theory of working memory
  publication-title: Science
  doi: 10.1126/science.1150769
– start-page: 41
  volume-title: Artificial General Intelligence
  year: 2011
  ident: B139
  article-title: Planning to be surprised: optimal Bayesian exploration in dynamic environments
  doi: 10.1007/978-3-642-22887-2_5
– volume: 67
  start-page: 145
  year: 1992
  ident: B79
  article-title: Responses of monkey dopamine neurons during learning of behavioral interactions
  publication-title: J. Neurophysiol.
  doi: 10.1152/jn.1992.67.1.145
– year: 2017
  ident: B88
  article-title: Opposite initialization to novel cues in dopamine signaling in ventral and posterior striatum in mice
  publication-title: eLife
  doi: 10.7554/eLife.21886
– volume: 1
  start-page: 11
  year: 2000
  ident: B3
  article-title: Is heterosynaptic modulation essential for stabilizing hebbian plasiticity and memory
  publication-title: Nat. Rev. Neurosci.
  doi: 10.1038/35036191
– volume: 8
  start-page: 791
  year: 1983
  ident: B71
  article-title: Temporal contiguity requirements for long-term associative potentiation/depression in hippocampus
  publication-title: Neurosci
  doi: 10.1016/0306-4522(83)90010-6
– volume: 359
  start-page: 113
  year: 1985
  ident: B13
  article-title: Reinforcement delay of one second severely impairs acquisition of brain self-stimulation
  publication-title: Brain Res.
  doi: 10.1016/0006-8993(85)91418-0
– volume: 26
  start-page: 8368
  year: 2006
  ident: B52
  article-title: Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning
  publication-title: J. Neurosci.
  doi: 10.1523/JNEUROSCI.0271-06.2006
– volume: 20
  start-page: 2451
  year: 2000
  ident: B97
  article-title: Synaptic activation modulates the induction of bidirectional synaptic changes in adult mouse hippocampus
  publication-title: J. Neurosci.
  doi: 10.1523/JNEUROSCI.20-07-02451.2000
– volume: 27
  start-page: 37
  year: 1948
  ident: B128
  article-title: A mathematical theory of communication
  publication-title: Bell Syst. Techn. J.
  doi: 10.1002/j.1538-7305.1948.tb01338.x
– volume: 59
  start-page: 4498
  year: 1999
  ident: B66
  article-title: Hebbian learning and spiking neurons
  publication-title: Phys. Rev. E
  doi: 10.1103/PhysRevE.59.4498
– volume-title: The Organization of Behavior
  year: 1949
  ident: B55
– year: 2015
  ident: B20
  article-title: Retroactive modulation of spike timing-dependent plasticity by dopamine
  publication-title: eLife
  doi: 10.7554/eLife.09685
– volume: 10
  start-page: 113
  year: 2009
  ident: B22
  article-title: State-dependent computations: spatiotemporal processing in cortical networks
  publication-title: Nat. Rev. Neurosci.
  doi: 10.1038/nrn2558
– volume: 16
  start-page: 710
  year: 2006
  ident: B53
  article-title: The role of acetylcholine in learning and memory
  publication-title: Curr. Opin. Neurobiol.
  doi: 10.1016/j.conb.2006.09.002
– volume: 4
  start-page: e1000180
  year: 2008
  ident: B70
  article-title: A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback
  publication-title: PLoS Comput. Biol.
  doi: 10.1371/journal.pcbi.1000180
– volume: 82
  start-page: 3055
  year: 1985
  ident: B73
  article-title: A mechanism for memory storage insensitive to molecular turnover: a bistable autophosphorylating kinase
  publication-title: Proc. Natl. Acad. Sci. U.S.A.
  doi: 10.1073/pnas.82.9.3055
– volume: 12
  start-page: 219
  ident: B32
  article-title: Temporal difference learning in continuous time and space
  publication-title: Neural Comput.
  doi: 10.1162/089976600300015961
– volume: 11
  start-page: e1004031
  year: 2015
  ident: B34
  article-title: The formation of multi-synaptic connections by the interaction of synaptic and structural plasticity and their functional consequences
  publication-title: PLoS Comput. Biol.
  doi: 10.1371/journal.pcbi.1004031
– volume: 232
  start-page: 351
  year: 1973
  ident: B12
  article-title: Long-lasting potentation of synaptic transmission in the dendate area of anaesthetized rabbit following stimulation of the perforant path
  publication-title: J. Physiol.
– volume: 16
  start-page: 480
  year: 1993
  ident: B2
  article-title: Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation
  publication-title: Trends Neurosci.
  doi: 10.1016/0166-2236(93)90081-V
– volume: 12
  start-page: e1005003
  year: 2016
  ident: B17
  article-title: Prospective coding by spiking neurons
  publication-title: PLoS Comput. Biol.
  doi: 10.1371/journal.pcbi.1005003
– volume: 14
  start-page: 2531
  year: 2002
  ident: B82
  article-title: Real-time computing without stable states: a new framework for neural computation based on perturbations
  publication-title: Neural Comput.
  doi: 10.1162/089976602760407955
– volume-title: Reinforcement Learning
  year: 1998
  ident: B142
– volume: 88
  start-page: 528
  year: 2015
  ident: B54
  article-title: Distinct eligibility traces for LTP and LTD in cortical synapses
  publication-title: Neuron
  doi: 10.1016/j.neuron.2015.09.037
– volume: 275
  start-page: 1593
  year: 1997
  ident: B124
  article-title: A neural substrate for prediction and reward
  publication-title: Science
  doi: 10.1126/science.275.5306.1593
– volume: 46
  start-page: 681
  year: 2005
  ident: B156
  article-title: Uncertainty, neuromodulation, and attention
  publication-title: Neuron
  doi: 10.1016/j.neuron.2005.04.026
– volume: 80
  start-page: 1
  year: 1998
  ident: B122
  article-title: Predictive reward signal of dopamine neurons
  publication-title: J. Neurophysiol.
  doi: 10.1152/jn.1998.80.1.1
– volume: 117
  start-page: 500
  year: 1952
  ident: B58
  article-title: A quantitative description of membrane current and its application to conduction and excitation in nerve
  publication-title: J Physiol
  doi: 10.1113/jphysiol.1952.sp004764
– volume: 91
  start-page: 871
  year: 1999
  ident: B140
  article-title: A neural network with dopamine-like reinforcement signal that learns a spatial delayed response task
  publication-title: Neuroscience
  doi: 10.1016/S0306-4522(98)00697-6
– volume: 385
  start-page: 533
  year: 1997
  ident: B41
  article-title: Synaptic tagging and long-term potentiation
  publication-title: Nature
  doi: 10.1038/385533a0
– volume: 19
  start-page: 1697
  year: 2016
  ident: B8
  article-title: Computational principles of synaptic memory consolidation
  publication-title: Nat. Neurosci.
  doi: 10.1038/nn.4401
– volume: 255
  start-page: 209
  year: 1992
  ident: B81
  article-title: Selection of intrinsic horizontal connections in the visual cortex by correlated neuronal activity
  publication-title: Science
  doi: 10.1126/science.1372754
– volume: 83
  start-page: 287
  year: 2000
  ident: B1
  article-title: Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity
  publication-title: Biol. Cybern.
  doi: 10.1007/s004220000171
– volume: 33
  start-page: 9565
  year: 2013
  ident: B18
  article-title: Matching recall and storage in sequence learning with spiking neural networks
  publication-title: J. Neurosci.
  doi: 10.1523/JNEUROSCI.4098-12.2013
– volume: 20
  start-page: 8812
  year: 2000
  ident: B149
  article-title: Stable Hebbian learning from spike timing-dependent plasticity
  publication-title: J. Neurosci.
  doi: 10.1523/JNEUROSCI.20-23-08812.2000
– volume: 132
  start-page: 349
  year: 1960
  ident: B57
  article-title: Pupil size as related to interest value of visual stimuli
  publication-title: Science
  doi: 10.1126/science.132.3423.349
– volume-title: Animal Intelligence
  year: 1911
  ident: B146
– volume: 133
  start-page: 1
  year: 1972
  ident: B67
  publication-title: Brain Function and Adaptive Systems-a Heterostatic Theory
– volume: 345
  start-page: 1616
  year: 2014
  ident: B155
  article-title: A critical time window for dopamine actions on the structural plasticity of dendritic spines
  publication-title: Science
  doi: 10.1126/science.1255514
– volume: 81
  start-page: 521
  year: 2014
  ident: B148
  article-title: Learning by the dendritic prediction of somatic spiking
  publication-title: Neuron
  doi: 10.1016/j.neuron.2013.11.030
– volume: 79
  start-page: 2554
  year: 1982
  ident: B59
  article-title: Neural networks and physical systems with emergent collective computational abilities
  publication-title: Proc. Natl. Acad. Sci. U.S.A.
  doi: 10.1073/pnas.79.8.2554
– volume: 482
  start-page: 47
  year: 2012
  ident: B23
  article-title: Conditional modulation of spike-timing-dependent plasticity for olfactory learning
  publication-title: Nature
  doi: 10.1038/nature10776
– volume: 68
  start-page: 862
  year: 2016
  ident: B43
  article-title: Active inference and learning
  publication-title: Neurosci. and Behav. Rev.
  doi: 10.1016/j.neubiorev.2016.06.022
– volume: 267
  start-page: 60
  year: 1992
  ident: B129
  article-title: The developing brain
  publication-title: Sci. Am.
  doi: 10.1038/scientificamerican0992-60
– volume: 304
  start-page: 78
  year: 2004
  ident: B64
  article-title: Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication
  publication-title: Science
  doi: 10.1126/science.1091277
– volume: 3
  start-page: e221
  year: 2007
  ident: B48
  article-title: STDP in a bistable synapse model based on CaMKII and associate signaling pathways
  publication-title: PLoS Comput. Biol.
  doi: 10.1371/journal.pcbi.0030221
– volume: 357
  start-page: 1033
  year: 2017
  ident: B11
  article-title: Behavioral time scale synaptic plasticity underlies CA1 place fields
  publication-title: Nature
  doi: 10.1126/science.aan3846
– volume: 36
  start-page: 241
  year: 2002
  ident: B123
  article-title: Getting formal with dopamine and reward
  publication-title: Neuron
  doi: 10.1016/S0896-6273(02)00967-4
– volume: 108
  start-page: 19383
  year: 2011
  ident: B47
  article-title: A triplet spike-timing dependent plasticity model generalizes the Bienenstock-Cooper-Munro rule to higher-order spatiotemporal correlations
  publication-title: Proc. Natl. Sci. Acad. U.S.A.
  doi: 10.1073/pnas.1105933108
– volume: 52
  start-page: 24
  year: 2007
  ident: B108
  article-title: The late maintenance of hippocampal LTP: requirements, phases, synaptic tagging, late associativity and implications
  publication-title: Neuropharmacology
  doi: 10.1016/j.neuropharm.2006.07.026
– volume: 412
  start-page: 549
  year: 2001
  ident: B121
  article-title: Practising orientation identification improves orientation coding in V1 neurons
  publication-title: Nature
  doi: 10.1038/35087601
– volume: 11
  start-page: 127
  year: 2010
  ident: B42
  article-title: The free-energy principle: a unified brain theory?
  publication-title: Nat. Rev. Neurosci.
  doi: 10.1038/nrn2787
– volume: 312
  start-page: 101
  year: 1984
  ident: B26
  article-title: Neurobiology-memory and molecular turnover
  publication-title: Nature
  doi: 10.1038/312101a0
– volume: 219
  start-page: 736
  year: 1968
  ident: B27
  article-title: Cortical synapses and reinforcement: a hypothesis
  publication-title: Nature
  doi: 10.1038/219736a0
– volume: 2
  start-page: 230
  year: 2010
  ident: B120
  article-title: Formal theory of creativity, fun, and intrinsic motivation (1990–2010)
  publication-title: IEEE Trans. Auton. Mental Dev.
  doi: 10.1109/TAMD.2010.2056368
– volume: 4
  start-page: 1086
  year: 2001
  ident: B87
  article-title: Dendritic spine geometry is critical for AMPA receptor expression in hippocampal CA1 pyramidal neurons
  publication-title: Nat. Neurosci.
  doi: 10.1038/nn736
– volume-title: The Hippocampus as a Cognitive Map
  year: 1978
  ident: B99
– volume: 537
  start-page: 357
  year: 2016
  ident: B145
  article-title: Locus coeruleus and dopaminergic consolidation of everyday memory
  publication-title: Nature
  doi: 10.1038/nature19325
– volume: 106
  start-page: 222
  year: 2015
  ident: B69
  article-title: A computational analysis of the neural bases of bayesian inference
  publication-title: NeuroImage
  doi: 10.1016/j.neuroimage.2014.11.007
– volume: 2
  start-page: 146
  year: 2010
  ident: B103
  article-title: Timing is not everything: neuromodulation opens the STDP gate
  publication-title: Front. Synaptic Neurosci.
  doi: 10.3389/fnsyn.2010.00146
– volume: 30
  start-page: 34
  year: 2018
  ident: B33
  article-title: Balancing new against old information: the role of puzzlement surprise in learning
  publication-title: Neural Comput.
  doi: 10.1162/neco_a_01025
– volume: 18
  start-page: 1318
  year: 2006
  ident: B104
  article-title: Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning
  publication-title: Neural Comput.
  doi: 10.1162/neco.2006.18.6.1318
– volume: 19
  start-page: 2881
  year: 2007
  ident: B16
  article-title: Learning real-world stimuli in a neural network with spike-driven synaptic dynamics
  publication-title: Neural Comput.
  doi: 10.1162/neco.2007.19.11.2881
– volume: 5
  start-page: 39
  year: 2011
  ident: B85
  article-title: A bayesian foundation for individual learning under uncertainty
  publication-title: Front. Hum. Neurosci.
  doi: 10.3389/fnhum.2011.00039
– volume: 103
  start-page: 15224
  year: 2006
  ident: B80
  article-title: Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity
  publication-title: Proc. Natl. Acad. Sci. U.S.A.
  doi: 10.1073/pnas.0505220103
– volume: 15
  start-page: 507
  year: 2002
  ident: B109
  article-title: Dopamine-dependent plasticity of corticostriatal synapses
  publication-title: Neural Netw.
  doi: 10.1016/S0893-6080(02)00045-X
– volume: 86
  start-page: 364
  year: 2001
  ident: B117
  article-title: Equilibrium properties of temporally asymmetric Hebbian plasticity
  publication-title: Phys. Rev. Lett.
  doi: 10.1103/PhysRevLett.86.364
– volume: 7
  start-page: 967
  year: 2006
  ident: B106
  article-title: The short-latency dopamine signal: a role in discovering novel actions?
  publication-title: Nat. Rev. Neurosci.
  doi: 10.1038/nrn2022
– volume: 395
  start-page: 37
  year: 1998
  ident: B158
  article-title: A critical window for cooperation and competition among developing retinotectal synapses
  publication-title: Nature
  doi: 10.1038/25665
– volume: 17
  start-page: 2176
  year: 2005
  ident: B112
  article-title: Attention-gated reinforcement learning of internal representations for classification
  publication-title: Neural Comput.
  doi: 10.1162/0899766054615699
– volume: 193
  start-page: 1141
  year: 1976
  ident: B137
  article-title: The effect of stimulus sequence on the waveform of the cortical event-related potential
  publication-title: Science
  doi: 10.1126/science.959831
– volume: 63
  start-page: 544
  year: 2009
  ident: B141
  article-title: Generating coherent patterns of activity from chaotic neural networks
  publication-title: Neuron
  doi: 10.1016/j.neuron.2009.07.018
– volume: 11
  start-page: e1004060
  year: 2015
  ident: B115
  article-title: How attention can create synaptic tags for the learning of working memories in sequential tasks
  publication-title: PLoS Comput. Biol.
  doi: 10.1371/journal.pcbi.1004060
– volume-title: Reinforcement Learning: an introduction
  year: 2018
  ident: B143
– volume: 8
  start-page: e1002689
  year: 2012
  ident: B29
  article-title: Spike-timing dependence of structural plasticity explains cooperative synapse formation in the neocortex
  publication-title: PLoS Comput. Biol.
  doi: 10.1371/journal.pcbi.1002689
– volume: 50
  start-page: 381
  year: 1996
  ident: B92
  article-title: The basal ganglia: focused selection and inhibition of competing motor programs
  publication-title: Progr. Neurobiol.
  doi: 10.1016/S0301-0082(96)00042-1
– year: 2017
  ident: B21
  article-title: Sequential neuromodulation of hebbian plasticity offers mechanism for effective reward-based navigation
  publication-title: eLife
  doi: 10.7554/eLife.27756
– volume: 8
  start-page: 1704
  year: 2005
  ident: B28
  article-title: Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
  publication-title: Nat. Neurosci.
  doi: 10.1038/nn1560
– volume: 4
  start-page: 229
  year: 1985
  ident: B6
  article-title: Learning by statistical cooperation of self-interested neuron-like computing elements
  publication-title: Hum. Neurobiol.
– volume: 358
  start-page: 829
  year: 2003
  ident: B75
  article-title: Long-term potentiation: outstanding questions and attempted synthesis
  publication-title: Phil. Trans. R. Soc. Lond B Biol. Sci.
  doi: 10.1098/rstb.2002.1242
– volume: 91
  start-page: 377
  year: 2009
  ident: B100
  article-title: Response acquisition by humans with delayed reinforcement
  publication-title: J. Exp. Anal. Behav.
  doi: 10.1901/jeab.2009.91-377
– volume: 37
  start-page: 92
  year: 2016
  ident: B151
  article-title: Brain structure and dynamics across scales: in search of rules
  publication-title: Curr. Opin. Neurobiol.
  doi: 10.1016/j.conb.2015.12.010
– volume: 22
  start-page: 123
  year: 1996
  ident: B134
  article-title: Reinforcement learning with replacing eligibility traces
  publication-title: Mach. Learn.
  doi: 10.1007/BF00114726
– volume: 28
  start-page: 1396
  year: 2018
  ident: B30
  article-title: Multicontact co-operativity in spike-timing-dependent structural plasticity stabilizes networks
  publication-title: Cereb. Cortex
  doi: 10.1093/cercor/bhx339
– volume-title: Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex.
  year: 1927
  ident: B102
– volume: 23
  start-page: 472
  year: 2000
  ident: B125
  article-title: Neuronal coding of prediction errors
  publication-title: Ann. Rev. Neurosci.
  doi: 10.1146/annurev.neuro.23.1.473
– volume: 7
  start-page: 13276
  year: 2016
  ident: B72
  article-title: Random synaptic feedback weights support error backpropagation for deep learning
  publication-title: Nat. Commun.
  doi: 10.1038/ncomms13276
– volume: 5
  start-page: 171
  year: 1995
  ident: B19
  article-title: Simulation of spatial learning in the Morris water maze by a neural network model of the hippocampal-formation and nucleus accumbens
  publication-title: Hippocampus
  doi: 10.1002/hipo.450050304
– volume: 111
  start-page: 815
  year: 2002
  ident: B50
  article-title: Neuromodulatory transmitter systems in the cortex and their role in cortical plasticity
  publication-title: Neuroscience
  doi: 10.1016/S0306-4522(02)00026-X
– volume: 11
  start-page: 265
  year: 2007
  ident: B101
  article-title: Intrinsic motivation systems for autonomous mental development
  publication-title: IEEE Trans. Evol. Comput.
  doi: 10.1109/TEVC.2006.890271
– volume: 80
  start-page: 704
  year: 2013
  ident: B60
  article-title: AMPARs and synaptic plasticity: the last 25 years
  publication-title: Neuron
  doi: 10.1016/j.neuron.2013.10.025
– volume: 27
  start-page: 7476
  year: 2007
  ident: B94
  article-title: Induction of long-term memory by exposure to novelty requires protein synthesis: Evidence for a behavioral tagging
  publication-title: J. Neurosci.
  doi: 10.1523/JNEUROSCI.1083-07.2007
– volume: 5
  start-page: e1000259
  year: 2009
  ident: B4
  article-title: State based model of long-term potentiation and synaptic tagging and capture
  publication-title: PLoS Comput. Biol.
  doi: 10.1371/journal.pcbi.1000259
– volume: 383
  start-page: 76
  year: 1996
  ident: B46
  article-title: A neuronal learning rule for sub-millisecond temporal coding
  publication-title: Nature
  doi: 10.1038/383076a0
– volume: 9
  start-page: e1003024
  year: 2013
  ident: B40
  article-title: Reinforcement learning using continuous time actor-critic framework with spiking neurons
  publication-title: PLoS Comput. Biol.
  doi: 10.1371/journal.pcbi.1003024
– volume: 86
  start-page: 9574
  year: 1989
  ident: B74
  article-title: A mechanism for Hebb and anti-Hebb processes underlying learning and memory
  publication-title: Proc. Natl. Acad. Sci. U.S.A.
  doi: 10.1073/pnas.86.23.9574
– volume: 15
  start-page: 267
  year: 1982
  ident: B98
  article-title: A simplified neuron model as a principal component analyzer
  publication-title: J. Math. Biol.
  doi: 10.1007/BF00275687
– start-page: 1928
  volume-title: Proceedings of the 33rd International Conference on Machine Learning
  year: 2016
  ident: B93
  article-title: Asynchronous methods for deep reinforcement learning
– volume: 13
  start-page: 35
  year: 2001
  ident: B126
  article-title: An algorithm for modifying neurotransmitter release probability based on pre- and postsynaptic spike timing
  publication-title: Neural Comput.
  doi: 10.1162/089976601300014628
– volume: 6
  start-page: 359
  year: 2013
  ident: B68
  article-title: A model-based approach to trial-by-trial p300 amplitude fluctuations
  publication-title: Front. Hum. Neurosci.
  doi: 10.3389/fnhum.2012.00359
– volume: 361
  start-page: 31
  year: 1993
  ident: B14
  article-title: A synaptic model of memory: long-term potentiation in the hippocampus
  publication-title: Nature
  doi: 10.1038/361031a0
– volume: 7
  start-page: 37
  year: 2013
  ident: B78
  article-title: Learning and exploration in action-perception loops
  publication-title: Front. Neural Circ.
  doi: 10.3389/fncir.2013.00037
– volume: 5
  start-page: 1471
  year: 2004
  ident: B49
  article-title: Variance reduction techniques for gradient estimates in reinforcement learning
  publication-title: J. Machine Learn. Res/
– start-page: 1458
  volume-title: Proceedings of the International Joint Conference on Neural Networks
  year: 1991
  ident: B118
  article-title: Curious model-building control systems
– volume: 32
  start-page: 1149
  year: 2001
  ident: B135
  article-title: Rate, timing, and cooperativity jointly determine cortical synaptic plasticity
  publication-title: Neuron
  doi: 10.1016/S0896-6273(01)00542-6
– volume: 15
  start-page: 1511
  year: 2003
  ident: B63
  article-title: Relating STDP to BCM
  publication-title: Neural Comput.
  doi: 10.1162/089976603321891783
– volume: 10
  start-page: 732
  ident: B31
  article-title: Complementary roles of basal ganglia and cerebellum in learning and motor control
  publication-title: Curr. Opin. Neurobiol.
  doi: 10.1016/S0959-4388(00)00153-7
– volume: 33
  start-page: 4693
  year: 2013
  ident: B35
  article-title: Diversity and homogeneity in responses of midbrain dopamine neurons
  publication-title: J. Neurosci.
  doi: 10.1523/JNEUROSCI.3886-12.2013
– volume: 86
  start-page: 1478
  year: 2015
  ident: B105
  article-title: Learning enhances sensory and multiple non-sensory representations in primary visual cortex
  publication-title: Neuron
  doi: 10.1016/j.neuron.2015.05.037
– volume: 8
  start-page: 38
  year: 2014
  ident: B110
  article-title: Stochastic variational learning in recurrent spiking networks
  publication-title: Front. Comput. Neurosci.
  doi: 10.3389/fncom.2014.00038
– volume: 372
  start-page: 20160260
  year: 2017
  ident: B76
  article-title: Glutamatergic synapses are structurally and biochemically complex because of multiple plasticity processes: long-term potentiation, long-term depression, short-term potentiation and scaling
  publication-title: Phil. Trans. Roy. Soc. B
  doi: 10.1098/rstb.2016.0260
– volume: 30
  start-page: 12366
  year: 2010
  ident: B96
  article-title: An approximately bayesian delta-rule model explains the dynamics of belief updating in a changing environment
  publication-title: J. Neurosci.
  doi: 10.1523/JNEUROSCI.0822-10.2010
– volume: 357
  start-page: 1133
  year: 2015
  ident: B10
  article-title: Conjunctive input processing drives feature selectivity in hippocampal CA1 neurons
  publication-title: Nat. Neurosci.
  doi: 10.1038/nn.4062
– volume: 12
  start-page: 250
  year: 2009
  ident: B147
  article-title: Reinforcement learning in populations of spiking neurons
  publication-title: Nat. Neurosci.
  doi: 10.1038/nn.2264
– volume-title: Hebbian Synaptic Modification in Spiking Neurons That Learn
  year: 1999
  ident: B5
– volume: 31
  start-page: 236
  year: 2000
  ident: B90
  article-title: Basal ganglia and cerebellar loops: motor and cognitive circuits
  publication-title: Brain Res. Rev.
  doi: 10.1016/S0165-0173(99)00040-5
– volume: 14
  start-page: 64
  year: 2010
  ident: B113
  article-title: Perceptual learning rules based on reinforcers and attention
  publication-title: Trends Cogn. Sci.
  doi: 10.1016/j.tics.2009.11.005
– volume: 82
  start-page: 444
  year: 2014
  ident: B15
  article-title: Structural and molecular remodeling of dendritic spine substructures during long-term potentation
  publication-title: Neuron
  doi: 10.1016/j.neuron.2014.03.021
– volume: 275
  start-page: 213
  year: 1997
  ident: B83
  article-title: Regulation of synaptic efficacy by coincidence of postysnaptic AP and EPSP
  publication-title: Science
  doi: 10.1126/science.275.5297.213
– volume: 3
  start-page: 919
  year: 2000
  ident: B136
  article-title: Competitive Hebbian learning through spike-time-dependent synaptic plasticity
  publication-title: Nat. Neurosci.
  doi: 10.1038/78829
– volume: 6
  start-page: 100
  year: 1994
  ident: B91
  article-title: The role of constraints in hebbian learning
  publication-title: Neural Comput.
  doi: 10.1162/neco.1994.6.1.100
– volume: 88
  start-page: 135
  year: 1981
  ident: B144
  article-title: Towards a modern theory of adaptive networks: expectation and prediction
  publication-title: Psychol. Rev.
  doi: 10.1037/0033-295X.88.2.135
SSID ssj0062654
Score 2.5927157
SecondaryResourceType review_article
Snippet Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in...
SourceID doaj
pubmedcentral
proquest
pubmed
crossref
SourceType Open Website
Open Access Repository
Aggregation Database
Index Database
Enrichment Source
StartPage 53
SubjectTerms Behavioral plasticity
Brain - physiology
Computer science
Dopamine
Electrophysiological Phenomena - physiology
eligibility trace
Experiments
hebb rule
Humans
Learning
Learning - physiology
Memory
Models, Biological
Neural networks
Neuromodulation
neuromodulators
Neuronal Plasticity - physiology
Neurons - physiology
Neuroscience
Neurosciences
Punishment
Reinforcement
reinforcement learning
surprise
Synaptic plasticity
synaptic tagging
SummonAdditionalLinks – databaseName: DOAJ Directory of Open Access Journals
  dbid: DOA
  link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1La9wwEBYl9NBLaZo-3CZFhVLowawfkm3llpRdcghLaNOSm9Fj1C6kcsnuBkL_fGdkr9ktpbn0askga17fWKNvGHsnZal0DVkqnYcUQ4BJTZH71NG1XWG1NJFL7-t5PZ83V1fqYqvVF9WE9fTA_cZNfKW8hkKZsgFR5dpUujHaoJ1KC2UJ5H0R9WySqd4HI0qXoj-UxBRMTXywCyL_zKlwMpPlThCKXP1_A5h_1kluBZ7ZE_Z4QIz8pF_pPnsA4Sk7OAmYLf-44-95rOGMP8cP2K8pFRjHetc7jmEInQDXwfELxMhUPo1Pu8BPx6v5nG6A8M8oJ1ge8-kW2z-ndp8IzXnn-Ry6MzBETs4vUfSQzmKTHj5ws37jn9b4_jP2ZTa9_HiWDu0VUitltUqNF6YCUXii-FKIW4XzhfMuzxXIHCw4ME0pauugFspJj7aaOS-0lTprals-Z3uhC_CS8dpkjcbUJ9eZFtIbg7jGK-89hj5X1EXCJpv9bu3APU4tMK5bzEFIQm2UUEsSaqOEEvZhfONnz7vxj7mnJMJxHjFmxweoR-2gR-19epSww40CtIMZL9uiUBVB5LxJ2NtxGA2QTlV0gG6Nc8hPiwo9YcJe9PoyrgS9J_UrwJF6R5N2lro7EhbfI8l3ldUK4dWr__Ftr9kj2q3-l_Qh21vdrOGIPbS3q8Xy5k20nN_HHCNs
  priority: 102
  providerName: Directory of Open Access Journals
Title Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules
URI https://www.ncbi.nlm.nih.gov/pubmed/30108488
https://www.proquest.com/docview/2296139718
https://www.proquest.com/docview/2088746048
https://pubmed.ncbi.nlm.nih.gov/PMC6079224
https://doaj.org/article/f69fae29b38e461ab6a8bab5385ce33e
Volume 12
WOSCitedRecordID wos000440325400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 1662-5110
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0062654
  issn: 1662-5110
  databaseCode: DOA
  dateStart: 20070101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 1662-5110
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0062654
  issn: 1662-5110
  databaseCode: M~E
  dateStart: 20070101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
– providerCode: PRVPQU
  databaseName: Biological Science Database
  customDbUrl:
  eissn: 1662-5110
  dateEnd: 20211231
  omitProxy: false
  ssIdentifier: ssj0062654
  issn: 1662-5110
  databaseCode: M7P
  dateStart: 20071102
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/biologicalscijournals
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: ProQuest Central
  customDbUrl:
  eissn: 1662-5110
  dateEnd: 20211231
  omitProxy: false
  ssIdentifier: ssj0062654
  issn: 1662-5110
  databaseCode: BENPR
  dateStart: 20071102
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Publicly Available Content Database
  customDbUrl:
  eissn: 1662-5110
  dateEnd: 20211231
  omitProxy: false
  ssIdentifier: ssj0062654
  issn: 1662-5110
  databaseCode: PIMPY
  dateStart: 20071102
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/publiccontent
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Science Database
  customDbUrl:
  eissn: 1662-5110
  dateEnd: 20211231
  omitProxy: false
  ssIdentifier: ssj0062654
  issn: 1662-5110
  databaseCode: M2P
  dateStart: 20071102
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/sciencejournals
  providerName: ProQuest
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3daxQxEA_26oMvVlttT-sRQQQfltuPZLPri_Tkjgr2WEqV82nJZz2wu_U-hCL4tzuTy509kb74kodNAmFnMvPLZPIbQl5xnpVS2DjixtkIXICKVJq4yOCzXaYlV55L7_NHMR4Xk0lZhYDbPKRVrm2iN9Sm1Rgj76dpmSNaSYp3198jrBqFt6uhhMYO2UWmMtYhu4PhuDpf22JA65ytLifhKFb2XaOnSAKaYAJlzLMtZ-Q5-_8FNP_Ol7zlgEZ7_7v0R-RhgJ70ZKUrj8k92-yTg5MGjt1XN_Q19cmgPsq-T_bW1R5o2PwH5OcQk5d9Lu0NBRcHBobKxtAK8DemZsPXtqGDzbN_iq9LYDp4oPlbOrxVSYBiKVGA_bR1dGzbU6uQ-JxegFrZaOQLANHA-3pJz5cw_wn5NBpevD-NQumGSHOeLyLlmMotSx3Sh5WAiZlxqXEGhGR5YrU1VhUZE9pYwUrDHdiB2DgmNZdxIXT2lHSatrFHhAoVFxKOVYmMJeNOKcBMrnTOgVs1qUi7pL-WYa0DrzmW1_hWw_kGpV57qdco9dpLvUvebGZcrzg97hg7QLXYjEM2bv-hnV3WYXPXLi-dtGmpssKyPJEql4WSCnwJ1zbLbJccrxWjDiZiXv_Rii55uemGzY03NrKx7RLGoA9gOVjZLjlc6eBmJWCZsRYC9Igt7dxa6nZPM_3qCcTzWJQA3Z7dvazn5AH-h1Ug-5h0FrOlfUHu6x-L6XzWIztiUvTCfuv5UAa0Z2mFrfDtryH0Vx_Oqi-_AeU7PpM
linkProvider ProQuest
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1bb9MwFLbGQIIXBhuXwgAjARIPURMnTmIkhDZo1WmlqtBAe8t8HZUgGb2AKv4Tv5FznKSsCO1tD7zGdmQ5n88lPv4-Qp5xHguZ2TDgxtkAXIAKFItcYPDabqIlV55L79MwG43y42Mx3iC_2rswWFbZ2kRvqE2l8R95lzGRYrQS5W_OvgWoGoWnq62ERg2LQ7v8ASnb7PXBO_i-zxnr947eDoJGVSDQnKfzQLlEpTZhDpmtBIRriXHMOBNFwvLIamusyuMk08ZmiTDcAURD4xKpuQzzTMfw3ivkKoQRLPelguPW8kNuwJP6KBQSP9F1pZ4g5WiE5Zohj9dcn1cI-FdY-3d15jl319_63xbqFrnZBNZ0r94Jt8mGLbfJzl4p59XXJX1BfamrP0PYJlutlgVtTNsO-dnD0mxfKbyk4MDBfFJZGjqG7AILz-FpVdL9FakBxbszMBz86-wV7Z3TSaAolApJDa0cHdlqYBXSutMj2DQ26Ht5I9qw2p7SDwsYf4d8vJSVuUs2y6q09wnNVJhLSBojGcqEO6UgInTCOQdBg2EZ65Bui5lCN6ztKB7ypYDsDVFWeJQViLLCo6xDXq5GnNWMJRf03UcYrvoh17h_UE1Pi8Z0FS4VTlomVJzbJI2kSmWupAJPybWNY9shuy0Qi8YAzoo_KOyQp6tmMF14HiVLWy2gD3q4JAUf0iH3asyvZgJ-B5UeoCVb2w1rU11vKSefPT16GmYCAtMHF0_rCbk-OHo_LIYHo8OH5AauSf3LfpdszqcL-4hc09_nk9n0sd_jlJxc9l75DaFBljA
linkToPdf http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1ba9RAFB5qFfHFauslWnUEFXwIm8tMkhFEWrtLS8uySJW-pXOtC5rUvSiL_8xf5zmTZO2K9K0Pvs6NYfKdW-bMdwh5wXkqZG6jkBtnQzABKlRJ7EKDz3aZllx5Lr1PR_lwWJyciNEa-dW9hcG0yk4nekVtao3_yHtJIjL0VuKi59q0iNHe4N35txArSOFNa1dOo4HIoV38gPBt-vZgD771yyQZ9I_f74dthYFQc57NQuWYyixLHLJcCXDdmHGJcSaOheWx1dZYVaQs18bmTBjuAK6RcUxqLqMi1ymse41czxmshmmDyaizAhAncNZci0IQKHqu0mOkH40xdTPi6YoZ9NUC_uXi_p2pecH0DTb-50O7Q263DjfdaSTkLlmz1SbZ2qnkrP66oK-oT4H1dwubZKOrcUFblbdFfvYxZdtnEC8oGHZQq1RWho4g6sCEdGitK7q7JDug-KYGpoPdnb6h_Qv1EygWUIVgh9aODm29bxXSvdNjECYbDnzZI9qy3Z7RD3OYf498vJKTuU_Wq7qyDwnNVVRICCZjGUnGnVLgKTrhnANnwiR5EpBeh59St2zuWFTkSwlRHSKu9IgrEXGlR1xAXi9nnDdMJpeM3UVILschB7lvqCdnZavSSpcJJ20iVFpYlsVSZbJQUoEF5dqmqQ3IdgfKslWM0_IPIgPyfNkNKg3vqWRl6zmMQcvHMrAtAXnQ4H-5E7BHWAECevIVyVjZ6mpPNf7sadOzKBfgsD66fFvPyE0QkfLoYHj4mNzCI2n-5G-T9dlkbp-QG_r7bDydPPXiTsnpVYvKb9B_nuw
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Eligibility+Traces+and+Plasticity+on+Behavioral+Time+Scales%3A+Experimental+Support+of+NeoHebbian+Three-Factor+Learning+Rules&rft.jtitle=Frontiers+in+neural+circuits&rft.au=Gerstner%2C+Wulfram&rft.au=Lehmann%2C+Marco&rft.au=Liakoni%2C+Vasiliki&rft.au=Corneil%2C+Dane&rft.date=2018-07-31&rft.eissn=1662-5110&rft.volume=12&rft.spage=53&rft_id=info:doi/10.3389%2Ffncir.2018.00053&rft_id=info%3Apmid%2F30108488&rft.externalDocID=30108488
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1662-5110&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1662-5110&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1662-5110&client=summon