Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules

Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap...

Celý popis

Uložené v:

Podrobná bibliografia
Vydané v:	Frontiers in neural circuits Ročník 12; s. 53
Hlavní autori:	Gerstner, Wulfram, Lehmann, Marco, Liakoni, Vasiliki, Corneil, Dane, Brea, Johanni
Médium:	Journal Article
Jazyk:	English
Vydavateľské údaje:	Switzerland Frontiers Research Foundation 31.07.2018 Frontiers Media S.A
Predmet:	Behavioral plasticity Brain - physiology Computer science Dopamine Electrophysiological Phenomena - physiology eligibility trace Experiments hebb rule Humans Learning Learning - physiology Memory Models, Biological Neural networks Neuromodulation neuromodulators Neuronal Plasticity - physiology Neurons - physiology Neuroscience Neurosciences Punishment Reinforcement reinforcement learning surprise Synaptic plasticity synaptic tagging surprise synaptic tagging hebb rule neuromodulators behavioral learning synaptic plasticity eligibility trace reinforcement learning
ISSN:	1662-5110, 1662-5110
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!

Abstract	Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.
AbstractList	Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules. Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.
Author	Liakoni, Vasiliki Lehmann, Marco Brea, Johanni Corneil, Dane Gerstner, Wulfram
AuthorAffiliation	School of Computer Science and School of Life Sciences, École Polytechnique Fédérale de Lausanne , Lausanne , Switzerland
AuthorAffiliation_xml	– name: School of Computer Science and School of Life Sciences, École Polytechnique Fédérale de Lausanne , Lausanne , Switzerland
Author_xml	– sequence: 1 givenname: Wulfram surname: Gerstner fullname: Gerstner, Wulfram – sequence: 2 givenname: Marco surname: Lehmann fullname: Lehmann, Marco – sequence: 3 givenname: Vasiliki surname: Liakoni fullname: Liakoni, Vasiliki – sequence: 4 givenname: Dane surname: Corneil fullname: Corneil, Dane – sequence: 5 givenname: Johanni surname: Brea fullname: Brea, Johanni
BackLink	https://www.ncbi.nlm.nih.gov/pubmed/30108488$$D View this record in MEDLINE/PubMed
BookMark	eNp1Uk1vEzEQXaEi-gF3TsgSFy4J_lqvlwMSVCmtFAGi4WzZ3nHiaGMHe7ei4s_jJC1qK3GyNfPe05uZd1odhRigql4TPGVMtu9dsD5NKSZyijGu2bPqhAhBJzUh-OjB_7g6zXmNsaCi5i-qY4YJllzKk-rPrPdLb3zvh1u0SNpCRjp06Huv8-DtrhoD-gwrfeNj0j1a-A2ga6t7yB_Q7PcWUimEoXSux-02pgFFh75CvARjvA5osUoAkwtth5jQHHQKPizRj7HwX1bPne4zvLp7z6qfF7PF-eVk_u3L1fmn-cTWtRgmxnEjgFNHMKGtJB3vHO1cR0gLNQELHRjJeGM7aHjb1a4VDHeOa1trLBvLzqqrg24X9Vpti2GdblXUXu0LMS2VTmXYHpQTrdNAW8MkcEG0EVoabWomawuMQdH6eNDajmYDnS2jl608En3cCX6llvFGCdy0lPIi8O5OIMVfI-RBbXy20Pc6QByzoljKhgvMZYG-fQJdxzGFsipFaSsIaxuyQ7156OiflfsbF4A4AGyKOSdwqpxVDz7uDPpeEax2YVL7MKldmNQ-TIWInxDvtf9L-Qv0L8_x
CitedBy_id	crossref_primary_10_1038_s41467_023_40651_w crossref_primary_10_1162_neco_a_01452 crossref_primary_10_3389_fncom_2022_1037976 crossref_primary_10_1063_5_0186054 crossref_primary_10_1002_adfm_202213064 crossref_primary_10_3389_fnins_2021_644313 crossref_primary_10_1016_j_jmp_2022_102712 crossref_primary_10_1073_pnas_2318362121 crossref_primary_10_1016_j_neuroscience_2021_12_039 crossref_primary_10_1016_j_neuron_2022_03_026 crossref_primary_10_1038_s41467_022_30827_1 crossref_primary_10_1063_5_0258271 crossref_primary_10_1016_j_neucom_2023_126240 crossref_primary_10_1088_2634_4386_ad05da crossref_primary_10_1038_s41467_024_47481_4 crossref_primary_10_1038_s41583_023_00742_5 crossref_primary_10_1109_TNNLS_2024_3353571 crossref_primary_10_1177_10738584221108083 crossref_primary_10_1113_JP285566 crossref_primary_10_1371_journal_pcbi_1012030 crossref_primary_10_1016_j_conb_2018_09_007 crossref_primary_10_1073_pnas_2311709121 crossref_primary_10_1109_TNNLS_2022_3153985 crossref_primary_10_3389_fncom_2023_1198128 crossref_primary_10_3389_fnins_2023_1183321 crossref_primary_10_1113_JP285563 crossref_primary_10_1038_s42003_024_06540_8 crossref_primary_10_1109_JETCAS_2020_3032058 crossref_primary_10_1109_TNNLS_2024_3503658 crossref_primary_10_1162_neco_a_01671 crossref_primary_10_1038_s41467_020_15542_z crossref_primary_10_3389_fnsys_2022_979680 crossref_primary_10_1007_s00422_023_00966_9 crossref_primary_10_1038_s41583_021_00467_3 crossref_primary_10_1016_j_neuron_2019_05_041 crossref_primary_10_1038_s41565_023_01391_6 crossref_primary_10_1038_s41386_022_01374_6 crossref_primary_10_1371_journal_pcbi_1009854 crossref_primary_10_1007_s12559_022_10081_9 crossref_primary_10_1093_cercor_bhab306 crossref_primary_10_1016_j_tins_2021_12_008 crossref_primary_10_1016_j_neunet_2021_09_010 crossref_primary_10_3389_fnint_2023_935177 crossref_primary_10_1371_journal_pcbi_1008360 crossref_primary_10_3389_fpsyg_2023_1160648 crossref_primary_10_1523_JNEUROSCI_0170_24_2024 crossref_primary_10_1371_journal_pone_0313331 crossref_primary_10_1016_j_neuri_2025_100220 crossref_primary_10_1002_adem_202200439 crossref_primary_10_1016_j_biosystems_2022_104825 crossref_primary_10_1016_j_isci_2025_112340 crossref_primary_10_1038_s41467_022_35601_x crossref_primary_10_1038_s41467_022_33795_8 crossref_primary_10_1038_s41467_025_56345_4 crossref_primary_10_3390_sym13081344 crossref_primary_10_1016_j_neunet_2021_07_033 crossref_primary_10_1371_journal_pcbi_1008078 crossref_primary_10_1109_JPROC_2023_3273520 crossref_primary_10_3389_fncom_2021_640235 crossref_primary_10_1038_s41565_022_01095_3 crossref_primary_10_1371_journal_pone_0316453 crossref_primary_10_1016_j_neuroimage_2021_118780 crossref_primary_10_1038_s41598_021_02779_x crossref_primary_10_3389_fnbot_2021_629210 crossref_primary_10_1088_1748_0221_18_02_C02060 crossref_primary_10_1038_s41467_023_38570_x crossref_primary_10_1007_s13534_024_00436_6 crossref_primary_10_1146_annurev_neuro_090919_022842 crossref_primary_10_1038_s41586_024_07311_5 crossref_primary_10_1016_j_neures_2022_12_003 crossref_primary_10_1016_j_neuroscience_2022_01_028 crossref_primary_10_1038_s41598_022_22430_7 crossref_primary_10_1088_2634_4386_ac8828 crossref_primary_10_1371_journal_pcbi_1009070 crossref_primary_10_1038_s41467_022_29727_1 crossref_primary_10_3389_fncom_2023_1053097 crossref_primary_10_3389_fnsys_2018_00044 crossref_primary_10_1038_s41467_023_43432_7 crossref_primary_10_3389_fnbot_2022_904017 crossref_primary_10_1073_pnas_2111821118 crossref_primary_10_3389_fnins_2022_959626 crossref_primary_10_3389_fnbeh_2022_1068271 crossref_primary_10_1038_s41593_024_01671_x crossref_primary_10_1038_s41467_022_29870_9 crossref_primary_10_1109_TNNLS_2025_3527700 crossref_primary_10_1371_journal_pcbi_1011139 crossref_primary_10_3389_fncom_2019_00018 crossref_primary_10_1017_S0140525X23003424 crossref_primary_10_1021_acs_chemrev_4c00670 crossref_primary_10_3389_fmats_2024_1356610 crossref_primary_10_3389_frobt_2024_1435197 crossref_primary_10_7554_eLife_43299 crossref_primary_10_1038_s41467_021_27653_2 crossref_primary_10_1016_j_neuron_2022_09_008 crossref_primary_10_1109_ACCESS_2025_3582564 crossref_primary_10_1088_2634_4386_ac4a83 crossref_primary_10_1088_2634_4386_ad6733 crossref_primary_10_1088_2634_4386_ac4918 crossref_primary_10_1162_neco_a_01352 crossref_primary_10_1016_j_neunet_2022_03_021 crossref_primary_10_3389_fnins_2023_1149410 crossref_primary_10_1109_TNNLS_2024_3352653 crossref_primary_10_1111_ejn_14408 crossref_primary_10_7554_eLife_73046 crossref_primary_10_1073_pnas_2312992121 crossref_primary_10_3389_fncom_2022_954847 crossref_primary_10_1038_s41583_019_0200_y crossref_primary_10_1038_s41593_021_00857_x crossref_primary_10_1016_j_neucom_2023_126740 crossref_primary_10_1088_1748_3190_ac9ffc crossref_primary_10_1038_s41467_024_50205_3 crossref_primary_10_3389_fnins_2023_1248936 crossref_primary_10_1109_JPROC_2020_3045625 crossref_primary_10_1038_s42003_024_06203_8 crossref_primary_10_1038_s41598_019_52781_7 crossref_primary_10_1371_journal_pcbi_1011844 crossref_primary_10_1038_s41467_020_17236_y crossref_primary_10_7554_eLife_47463 crossref_primary_10_1523_JNEUROSCI_1950_21_2022 crossref_primary_10_3758_s13420_023_00591_3 crossref_primary_10_1016_j_pneurobio_2020_101881 crossref_primary_10_1038_s41598_020_75820_0 crossref_primary_10_1016_j_cub_2025_02_007 crossref_primary_10_1063_5_0157645 crossref_primary_10_1587_nolta_16_64 crossref_primary_10_1038_s41598_022_05637_6 crossref_primary_10_1109_TETCI_2022_3174905 crossref_primary_10_1038_s42256_024_00845_3 crossref_primary_10_1016_j_cub_2024_05_008 crossref_primary_10_3389_fncir_2022_836930 crossref_primary_10_1016_j_cobeha_2021_07_005 crossref_primary_10_1016_j_neuroimage_2023_120458 crossref_primary_10_1371_journal_pcbi_1011839 crossref_primary_10_1016_j_eswa_2024_126373 crossref_primary_10_1016_j_neuron_2022_12_034 crossref_primary_10_3389_fncom_2018_00049 crossref_primary_10_3390_s24196419 crossref_primary_10_1002_adma_202107754 crossref_primary_10_7554_eLife_81071
Cites_doi	10.1016/j.tins.2013.03.003 10.1115/1.3662552 10.1038/222960a0 10.1038/nn.2479 10.1038/nrn.2018.6 10.1152/jn.00803.2004 10.1126/science.1123513 10.1146/annurev.neuro.23.1.649 10.1162/neco.2007.19.6.1468 10.1371/journal.pcbi.1005260 10.1038/nrn2963 10.1002/(SICI)1098-1063(2000)10:1<1::AID-HIPO1>3.0.CO;2-1 10.1073/pnas.0900546106 10.1523/JNEUROSCI.6249-09.2010 10.7554/eLife.22901 10.1371/journal.pcbi.1000586 10.1016/j.visres.2008.09.007 10.1523/JNEUROSCI.3989-14.2015 10.3389/fncir.2015.00085 10.1038/416433a 10.1016/j.tins.2011.07.006 10.1523/JNEUROSCI.02-01-00032.1982 10.3389/neuro.10.007.2008 10.1111/ejn.13921 10.1016/j.neuron.2005.02.001 10.1371/journal.pcbi.1000248 10.1093/cercor/bhl152 10.1080/09540090600768658 10.1016/j.neuron.2012.03.037 10.1103/PhysRevE.69.041909 10.1073/pnas.152343099 10.1007/BF00992696 10.3389/fnhum.2014.00825 10.1126/science.1150769 10.1007/978-3-642-22887-2_5 10.1152/jn.1992.67.1.145 10.7554/eLife.21886 10.1038/35036191 10.1016/0306-4522(83)90010-6 10.1016/0006-8993(85)91418-0 10.1523/JNEUROSCI.0271-06.2006 10.1523/JNEUROSCI.20-07-02451.2000 10.1002/j.1538-7305.1948.tb01338.x 10.1103/PhysRevE.59.4498 10.7554/eLife.09685 10.1038/nrn2558 10.1016/j.conb.2006.09.002 10.1371/journal.pcbi.1000180 10.1073/pnas.82.9.3055 10.1162/089976600300015961 10.1371/journal.pcbi.1004031 10.1016/0166-2236(93)90081-V 10.1371/journal.pcbi.1005003 10.1162/089976602760407955 10.1016/j.neuron.2015.09.037 10.1126/science.275.5306.1593 10.1016/j.neuron.2005.04.026 10.1152/jn.1998.80.1.1 10.1113/jphysiol.1952.sp004764 10.1016/S0306-4522(98)00697-6 10.1038/385533a0 10.1038/nn.4401 10.1126/science.1372754 10.1007/s004220000171 10.1523/JNEUROSCI.4098-12.2013 10.1523/JNEUROSCI.20-23-08812.2000 10.1126/science.132.3423.349 10.1126/science.1255514 10.1016/j.neuron.2013.11.030 10.1073/pnas.79.8.2554 10.1038/nature10776 10.1016/j.neubiorev.2016.06.022 10.1038/scientificamerican0992-60 10.1126/science.1091277 10.1371/journal.pcbi.0030221 10.1126/science.aan3846 10.1016/S0896-6273(02)00967-4 10.1073/pnas.1105933108 10.1016/j.neuropharm.2006.07.026 10.1038/35087601 10.1038/nrn2787 10.1038/312101a0 10.1038/219736a0 10.1109/TAMD.2010.2056368 10.1038/nn736 10.1038/nature19325 10.1016/j.neuroimage.2014.11.007 10.3389/fnsyn.2010.00146 10.1162/neco_a_01025 10.1162/neco.2006.18.6.1318 10.1162/neco.2007.19.11.2881 10.3389/fnhum.2011.00039 10.1073/pnas.0505220103 10.1016/S0893-6080(02)00045-X 10.1103/PhysRevLett.86.364 10.1038/nrn2022 10.1038/25665 10.1162/0899766054615699 10.1126/science.959831 10.1016/j.neuron.2009.07.018 10.1371/journal.pcbi.1004060 10.1371/journal.pcbi.1002689 10.1016/S0301-0082(96)00042-1 10.7554/eLife.27756 10.1038/nn1560 10.1098/rstb.2002.1242 10.1901/jeab.2009.91-377 10.1016/j.conb.2015.12.010 10.1007/BF00114726 10.1093/cercor/bhx339 10.1146/annurev.neuro.23.1.473 10.1038/ncomms13276 10.1002/hipo.450050304 10.1016/S0306-4522(02)00026-X 10.1109/TEVC.2006.890271 10.1016/j.neuron.2013.10.025 10.1523/JNEUROSCI.1083-07.2007 10.1371/journal.pcbi.1000259 10.1038/383076a0 10.1371/journal.pcbi.1003024 10.1073/pnas.86.23.9574 10.1007/BF00275687 10.1162/089976601300014628 10.3389/fnhum.2012.00359 10.1038/361031a0 10.3389/fncir.2013.00037 10.1016/S0896-6273(01)00542-6 10.1162/089976603321891783 10.1016/S0959-4388(00)00153-7 10.1523/JNEUROSCI.3886-12.2013 10.1016/j.neuron.2015.05.037 10.3389/fncom.2014.00038 10.1098/rstb.2016.0260 10.1523/JNEUROSCI.0822-10.2010 10.1038/nn.4062 10.1038/nn.2264 10.1016/S0165-0173(99)00040-5 10.1016/j.tics.2009.11.005 10.1016/j.neuron.2014.03.021 10.1126/science.275.5297.213 10.1038/78829 10.1162/neco.1994.6.1.100 10.1037/0033-295X.88.2.135
ContentType	Journal Article
Copyright	2018. This work is licensed under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. Copyright © 2018 Gerstner, Lehmann, Liakoni, Corneil and Brea. 2018 Gerstner, Lehmann, Liakoni, Corneil and Brea
Copyright_xml	– notice: 2018. This work is licensed under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. – notice: Copyright © 2018 Gerstner, Lehmann, Liakoni, Corneil and Brea. 2018 Gerstner, Lehmann, Liakoni, Corneil and Brea
DBID	AAYXX CITATION CGR CUY CVF ECM EIF NPM 3V. 7XB 88I 8FE 8FH 8FK ABUWG AFKRA AZQEC BBNVY BENPR BHPHI CCPQU DWQXO GNUQQ HCIFZ LK8 M2P M7P PHGZM PHGZT PIMPY PKEHL PQEST PQGLB PQQKQ PQUKI PRINS Q9U 7X8 5PM DOA
DOI	10.3389/fncir.2018.00053
DatabaseName	CrossRef Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed ProQuest Central (Corporate) ProQuest Central (purchase pre-March 2016) Science Database (Alumni Edition) ProQuest SciTech Collection ProQuest Natural Science Collection ProQuest Central (Alumni) (purchase pre-March 2016) ProQuest Central (Alumni) ProQuest Central UK/Ireland ProQuest Central Essentials Biological Science Collection ProQuest Central Natural Science Collection ProQuest One ProQuest Central ProQuest Central Student SciTech Premium Collection Biological Sciences Science Database Biological Science Database ProQuest Central Premium ProQuest One Academic (New) Publicly Available Content Database ProQuest One Academic Middle East (New) ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China ProQuest Central Basic MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ Directory of Open Access Journals
DatabaseTitle	CrossRef MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) Publicly Available Content Database ProQuest Central Student ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College ProQuest Natural Science Collection ProQuest Central China ProQuest Central ProQuest One Applied & Life Sciences Natural Science Collection ProQuest Central Korea Biological Science Collection ProQuest Central (New) ProQuest Science Journals (Alumni Edition) ProQuest Biological Science Collection ProQuest Central Basic ProQuest Science Journals ProQuest One Academic Eastern Edition Biological Science Database ProQuest SciTech Collection ProQuest One Academic UKI Edition ProQuest One Academic ProQuest One Academic (New) ProQuest Central (Alumni) MEDLINE - Academic
DatabaseTitleList	Publicly Available Content Database MEDLINE - Academic MEDLINE
Database_xml	– sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 3 dbid: PIMPY name: ProQuest Publicly Available Content Database url: http://search.proquest.com/publiccontent sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Anatomy & Physiology Computer Science
EISSN	1662-5110
ExternalDocumentID	oai_doaj_org_article_f69fae29b38e461ab6a8bab5385ce33e PMC6079224 30108488 10_3389_fncir_2018_00053
Genre	Research Support, Non-U.S. Gov't Journal Article Review
GrantInformation_xml	– fundername: European Research Council grantid: 268689 – fundername: Horizon 2020 grantid: 720270 – fundername: Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung grantid: 200020 165538
GroupedDBID	--- 29H 2WC 53G 5GY 5VS 88I 8FE 8FH 9T4 AAFWJ AAYXX ABUWG ACGFS ADBBV ADRAZ AEGXH AENEX AFFHD AFKRA AFPKN ALMA_UNASSIGNED_HOLDINGS AOIJS AZQEC BAWUL BBNVY BCNDV BENPR BHPHI BPHCQ CCPQU CITATION CS3 DIK DU5 DWQXO E3Z EMOBN F5P GNUQQ GROUPED_DOAJ GX1 HCIFZ HYE INR KQ8 LK8 M2P M48 M7P M~E O5R O5S OK1 OVT PGMZT PHGZM PHGZT PIMPY PQGLB PQQKQ PROAC RNS RPM TR2 ACXDI C1A CGR CUY CVF ECM EIF IPNFZ NPM RIG 3V. 7XB 8FK PKEHL PQEST PQUKI PRINS Q9U 7X8 5PM
ID	FETCH-LOGICAL-c556t-bf4b6e42f1012981d4df2dfd119e51ecedeb8347cde749d5f9630df4ac5a087c3
IEDL.DBID	DOA
ISICitedReferencesCount	191
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000440325400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1662-5110
IngestDate	Mon Nov 10 04:31:50 EST 2025 Tue Nov 04 02:02:53 EST 2025 Sun Nov 09 10:51:01 EST 2025 Fri Jul 25 11:40:43 EDT 2025 Mon Jul 21 05:58:10 EDT 2025 Sat Nov 29 02:24:32 EST 2025 Tue Nov 18 22:04:50 EST 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Keywords	surprise synaptic tagging hebb rule neuromodulators behavioral learning synaptic plasticity eligibility trace reinforcement learning
Language	English
License	This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c556t-bf4b6e42f1012981d4df2dfd119e51ecedeb8347cde749d5f9630df4ac5a087c3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 ObjectType-Review-3 content type line 23 Reviewed by: Blake A. Richards, University of Toronto Scarborough, Canada; Joel Zylberberg, University of Colorado Anschutz Medical Campus, United States Edited by: Edward S. Ruthazer, McGill University, Canada
OpenAccessLink	https://doaj.org/article/f69fae29b38e461ab6a8bab5385ce33e
PMID	30108488
PQID	2296139718
PQPubID	4424406
ParticipantIDs	doaj_primary_oai_doaj_org_article_f69fae29b38e461ab6a8bab5385ce33e pubmedcentral_primary_oai_pubmedcentral_nih_gov_6079224 proquest_miscellaneous_2088746048 proquest_journals_2296139718 pubmed_primary_30108488 crossref_citationtrail_10_3389_fncir_2018_00053 crossref_primary_10_3389_fncir_2018_00053
PublicationCentury	2000
PublicationDate	2018-07-31
PublicationDateYYYYMMDD	2018-07-31
PublicationDate_xml	– month: 07 year: 2018 text: 2018-07-31 day: 31
PublicationDecade	2010
PublicationPlace	Switzerland
PublicationPlace_xml	– name: Switzerland – name: Lausanne
PublicationTitle	Frontiers in neural circuits
PublicationTitleAlternate	Front Neural Circuits
PublicationYear	2018
Publisher	Frontiers Research Foundation Frontiers Media S.A
Publisher_xml	– name: Frontiers Research Foundation – name: Frontiers Media S.A
References	Suri (B140) 1999; 91 Ljunberg (B79) 1992; 67 Mathys (B86) 2014; 8 Little (B78) 2013; 7 Greensmith (B49) 2004; 5 Sun (B139) 2011 Barto (B6) 1985; 4 Buonomano (B22) 2009; 10 Mnih (B93) 2016 Singh (B134) 1996; 22 Urbanczik (B148) 2014; 81 Artola (B2) 1993; 16 Hess (B57) 1960; 132 Roeper (B114) 2013; 36 Bittner (B11) 2017; 357 Sutton (B143) 2018 Sutton (B142) 1998 Brzosko (B20) 2015 Fusi (B45) 2005; 45 Pavlov (B102) 1927 van Rossum (B149) 2000; 20 Reymann (B108) 2007; 52 Gu (B50) 2002; 111 Hodgkin (B58) 1952; 117 Daw (B28) 2005; 8 Schmidhuber (B119) 2006; 18 Itti (B61) 2009; 49 Gjorjieva (B47) 2011; 108 Meyniel (B89) 2016; 12 Maass (B82) 2002; 14 Redondo (B107) 2011; 12 Benna (B8) 2016; 19 Susillo (B141) 2009; 63 Zhang (B157) 2009; 106 Thorndike (B146) 1911 Schultz (B122) 1998; 80 Mathys (B85) 2011; 5 Singh (B133) 2004; 17 Nassar (B96) 2010; 30 Roelfsema (B111) 2018; 19 Mongillo (B95) 2008; 319 Wang (B151) 2016; 37 Guerguiev (B51) 2017 Shatz (B129) 1992; 267 Fauth (B34) 2015; 11 Barto (B7) 1983; 13 Bartlett (B5) 1999 Okouchi (B100) 2009; 91 Moncada (B94) 2007; 27 Schultz (B123) 2002; 36 Lisman (B77) 2011; 34 Pawlak (B103) 2010; 2 Doya (B32); 12 Gerstner (B46) 1996; 383 Florian (B36) 2007; 19 Urbanczik (B147) 2009; 12 Oja (B98) 1982; 15 Brea (B18) 2013; 33 Froemke (B44) 2002; 416 Rubin (B117) 2001; 86 Ziegler (B159) 2015; 35 Oudeyer (B101) 2007; 11 Shuler (B132) 2006; 311 Song (B136) 2000; 3 Graupner (B48) 2007; 3 Senn (B126) 2001; 13 Schultz (B125) 2000; 23 Shindou (B130) 2018 Xie (B154) 2004; 69 Yagishita (B155) 2014; 345 Kolossa (B69) 2015; 106 Lisman (B73) 1985; 82 Rezende (B110) 2014; 8 Helias (B56) 2008; 2 Schultz (B124) 1997; 275 Deger (B29) 2012; 8 Schmidhuber (B118) 1991 Hopfield (B59) 1982; 79 Haber (B52) 2006; 26 Lisman (B74) 1989; 86 Storck (B138) 1995 Bittner (B10) 2015; 357 Brader (B16) 2007; 19 Willshaw (B153) 1969; 222 Frémaux (B40) 2013; 9 Bienenstock (B9) 1982; 2 Clopath (B25) 2008; 4 Frémaux (B38) 2016; 9 Ngezahayo (B97) 2000; 20 Frey (B41) 1997; 385 Takeuchi (B145) 2016; 537 Clopath (B24) 2010; 13 Menegas (B88) 2017 Bliss (B14) 1993; 361 Lisman (B75) 2003; 358 Foster (B37) 2000; 10 Klopf (B67) 1972; 133 Brea (B17) 2016; 12 Kalman (B65) 1960; 82 O'Keefe (B99) 1978 Miller (B91) 1994; 6 Crick (B26) 1984; 312 Markram (B83) 1997; 275 Brown (B19) 1995; 5 Martin (B84) 2000; 23 Izhikevich (B62) 2007; 17 Squires (B137) 1976; 193 Bliss (B12) 1973; 232 Frémaux (B39) 2010; 40 Middleton (B90) 2000; 31 Friston (B43) 2016; 68 Seo (B127) 2012; 74 Redgrave (B106) 2006; 7 Levy (B71) 1983; 8 Sutton (B144) 1981; 88 Vasilaki (B150) 2009; 5 Crow (B27) 1968; 219 Rubin (B116) 2005; 93 Fiorillo (B35) 2013; 33 Izhikevich (B63) 2003; 15 Jaeger (B64) 2004; 304 Lillicrap (B72) 2016; 7 Poort (B105) 2015; 86 Bosch (B15) 2014; 82 Pfister (B104) 2006; 18 Rombouts (B115) 2015; 11 Yu (B156) 2005; 46 Reynolds (B109) 2002; 15 Shannon (B128) 1948; 27 Faraji (B33) 2018; 30 Arleo (B1) 2000; 83 Brzosko (B21) 2017 Barrett (B4) 2009; 5 Williams (B152) 1992; 8 Loewenstein (B80) 2006; 103 Friston (B42) 2010; 11 Schmidhuber (B120) 2010; 2 Huganir (B60) 2013; 80 Hebb (B55) 1949 Kempter (B66) 1999; 59 Matsuzaki (B87) 2001; 4 Mink (B92) 1996; 50 Löwel (B81) 1992; 255 Sjöström (B135) 2001; 32 Roelfsema (B113) 2010; 14 Schoups (B121) 2001; 412 Hasselmo (B53) 2006; 16 Lisman (B76) 2017; 372 He (B54) 2015; 88 Cassenaer (B23) 2012; 482 Shouval (B131) 2002; 99 Deger (B30) 2018; 28 Legenstein (B70) 2008; 4 Kolossa (B68) 2013; 6 Zhang (B158) 1998; 395 Roelfsema (B112) 2005; 17 Doya (B31); 10 Bailey (B3) 2000; 1 Black (B13) 1985; 359
References_xml	– volume: 36 start-page: 336 year: 2013 ident: B114 article-title: Dissecting the diversity of midbrain dopamine neurons publication-title: Trends Neurosci. doi: 10.1016/j.tins.2013.03.003 – volume: 82 start-page: 35 year: 1960 ident: B65 article-title: A new approach to linear filtering and prediction problems publication-title: J. Basic Eng. doi: 10.1115/1.3662552 – volume: 222 start-page: 960 year: 1969 ident: B153 article-title: Non-holographic associative memory publication-title: Nature doi: 10.1038/222960a0 – volume: 13 start-page: 344 year: 2010 ident: B24 article-title: Connectivity reflects coding: a model of voltage-based spike-timing-dependent-plasticity with homeostasis publication-title: Nat. Neurosci. doi: 10.1038/nn.2479 – volume: 19 start-page: 166 year: 2018 ident: B111 article-title: Control of synaptic plasticity in deep cortical networks publication-title: Nat. Rev. Neurosci. doi: 10.1038/nrn.2018.6 – volume: 93 start-page: 2600 year: 2005 ident: B116 article-title: Calcium time course as a signal for spike-timing-dependent plasticity publication-title: J. Neurophysiol. doi: 10.1152/jn.00803.2004 – volume: 311 start-page: 1606 year: 2006 ident: B132 article-title: Reward timing in the primary visual cortex publication-title: Science doi: 10.1126/science.1123513 – volume: 23 start-page: 649 year: 2000 ident: B84 article-title: Synaptic plasticity and memory: an evaluation of the hypothesis publication-title: Ann. Rev. Neurosci. doi: 10.1146/annurev.neuro.23.1.649 – volume: 19 start-page: 1468 year: 2007 ident: B36 article-title: Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity publication-title: Neural Comput. doi: 10.1162/neco.2007.19.6.1468 – volume: 12 start-page: e1005260 year: 2016 ident: B89 article-title: Human inferences about sequences: a minimal transition probability model publication-title: PLoS Comput. Biol. doi: 10.1371/journal.pcbi.1005260 – start-page: 159 volume-title: Proceedings of ICANN'95 year: 1995 ident: B138 article-title: Reinforcement-driven information acquisition in non-deterministic environments – volume: 12 start-page: 17 year: 2011 ident: B107 article-title: Making memories last: the synaptic tagging and capture hypothesis publication-title: Nat. Rev. Neurosci. doi: 10.1038/nrn2963 – volume: 10 start-page: 1 year: 2000 ident: B37 article-title: Models of hippocampally dependent navigation using the temporal difference learning rule publication-title: Hippocampus doi: 10.1002/(SICI)1098-1063(2000)10:1<1::AID-HIPO1>3.0.CO;2-1 – volume: 106 start-page: 13028 year: 2009 ident: B157 article-title: Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses publication-title: Proc. Natl. Acad. Sci. U.S.A. doi: 10.1073/pnas.0900546106 – volume: 40 start-page: 13326 year: 2010 ident: B39 article-title: Functional requirements for reward-modulated spike-timing-dependent plasticity publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.6249-09.2010 – year: 2017 ident: B51 article-title: Towards deep learning with segregated dendrites publication-title: elife doi: 10.7554/eLife.22901 – volume: 5 start-page: e1000586 year: 2009 ident: B150 article-title: Spike-based reinforcement learning in continuous state and action space: When policy gradient methods fail publication-title: PLoS Comput.Biol. doi: 10.1371/journal.pcbi.1000586 – volume: 49 start-page: 1295 year: 2009 ident: B61 article-title: Bayesian surprise attracts human attention publication-title: Vis. Res. doi: 10.1016/j.visres.2008.09.007 – volume: 35 start-page: 1319 year: 2015 ident: B159 article-title: Synaptic consolidation: from synapses to behavioral modeling publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.3989-14.2015 – volume: 9 start-page: 85 year: 2016 ident: B38 article-title: Neuromodulated spike-timing dependent plasticity and theory of three-factor learning rules publication-title: Front. Neural Circ. doi: 10.3389/fncir.2015.00085 – volume: 416 start-page: 433 year: 2002 ident: B44 article-title: Spike-timing dependent plasticity induced by natural spike trains publication-title: Nature doi: 10.1038/416433a – volume: 34 start-page: 536 year: 2011 ident: B77 article-title: A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP publication-title: Trends Neurosci. doi: 10.1016/j.tins.2011.07.006 – volume: 2 start-page: 32 year: 1982 ident: B9 article-title: Theory of the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.02-01-00032.1982 – volume: 2 start-page: 7 year: 2008 ident: B56 article-title: Structural plasticity controlled by calcium based correlation detection publication-title: Front. Comput. Neurosci. doi: 10.3389/neuro.10.007.2008 – year: 2018 ident: B130 article-title: A silent eligibility trace enables dopamine-dependent synaptic plasticity for reinforcement learning in the mouse striatum publication-title: Eur. J. Neurosci. doi: 10.1111/ejn.13921 – volume: 45 start-page: 599 year: 2005 ident: B45 article-title: Cascade models of synaptically stored memories publication-title: Neuron doi: 10.1016/j.neuron.2005.02.001 – volume: 17 start-page: 1281 year: 2004 ident: B133 article-title: Intrinsically motivated reinforcement learning publication-title: Adv. Neural Inform. Proc. Syst. – volume: 4 start-page: e1000248 year: 2008 ident: B25 article-title: Tag-trigger-consolidation: a model of early and late long-term-potentiation and depression publication-title: PLoS Comput. Biol. doi: 10.1371/journal.pcbi.1000248 – volume: 17 start-page: 2443 year: 2007 ident: B62 article-title: Solving the distal reward problem through linkage of STDP and dopamine signaling publication-title: Cereb. Cortex doi: 10.1093/cercor/bhl152 – volume: 18 start-page: 173 year: 2006 ident: B119 article-title: Developmental robotics, optimal artificial curiosity, creativity, music, and the fine arts publication-title: Connect. Sci. doi: 10.1080/09540090600768658 – volume: 74 start-page: 947 year: 2012 ident: B127 article-title: Action selection and action value in frontal-striatal circuits publication-title: Neuron doi: 10.1016/j.neuron.2012.03.037 – volume: 69 start-page: 41909 year: 2004 ident: B154 article-title: Learning in neural networks by reinforcement of irregular spiking publication-title: Phys. Rev. E doi: 10.1103/PhysRevE.69.041909 – volume: 99 start-page: 10831 year: 2002 ident: B131 article-title: A unified model of NMDA receptor dependent bidirectional synaptic plasticity publication-title: Proc. Natl. Acad. Sci. U.S.A. doi: 10.1073/pnas.152343099 – volume: 13 start-page: 835 year: 1983 ident: B7 article-title: Neuronlike adaptive elements that can solve difficult learning and control problems publication-title: IEEE Trans. Syst. Man Cybern. – volume: 8 start-page: 229 year: 1992 ident: B152 article-title: Simple statistical gradient-following methods for connectionist reinforcement learning publication-title: Mach. Learn. doi: 10.1007/BF00992696 – volume: 8 start-page: 825 year: 2014 ident: B86 article-title: Uncertainty in perception and the hierarchical gaussian filter publication-title: Front. Hum. Neurosci. doi: 10.3389/fnhum.2014.00825 – volume: 319 start-page: 1543 year: 2008 ident: B95 article-title: Synaptic theory of working memory publication-title: Science doi: 10.1126/science.1150769 – start-page: 41 volume-title: Artificial General Intelligence year: 2011 ident: B139 article-title: Planning to be surprised: optimal Bayesian exploration in dynamic environments doi: 10.1007/978-3-642-22887-2_5 – volume: 67 start-page: 145 year: 1992 ident: B79 article-title: Responses of monkey dopamine neurons during learning of behavioral interactions publication-title: J. Neurophysiol. doi: 10.1152/jn.1992.67.1.145 – year: 2017 ident: B88 article-title: Opposite initialization to novel cues in dopamine signaling in ventral and posterior striatum in mice publication-title: eLife doi: 10.7554/eLife.21886 – volume: 1 start-page: 11 year: 2000 ident: B3 article-title: Is heterosynaptic modulation essential for stabilizing hebbian plasiticity and memory publication-title: Nat. Rev. Neurosci. doi: 10.1038/35036191 – volume: 8 start-page: 791 year: 1983 ident: B71 article-title: Temporal contiguity requirements for long-term associative potentiation/depression in hippocampus publication-title: Neurosci doi: 10.1016/0306-4522(83)90010-6 – volume: 359 start-page: 113 year: 1985 ident: B13 article-title: Reinforcement delay of one second severely impairs acquisition of brain self-stimulation publication-title: Brain Res. doi: 10.1016/0006-8993(85)91418-0 – volume: 26 start-page: 8368 year: 2006 ident: B52 article-title: Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.0271-06.2006 – volume: 20 start-page: 2451 year: 2000 ident: B97 article-title: Synaptic activation modulates the induction of bidirectional synaptic changes in adult mouse hippocampus publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.20-07-02451.2000 – volume: 27 start-page: 37 year: 1948 ident: B128 article-title: A mathematical theory of communication publication-title: Bell Syst. Techn. J. doi: 10.1002/j.1538-7305.1948.tb01338.x – volume: 59 start-page: 4498 year: 1999 ident: B66 article-title: Hebbian learning and spiking neurons publication-title: Phys. Rev. E doi: 10.1103/PhysRevE.59.4498 – volume-title: The Organization of Behavior year: 1949 ident: B55 – year: 2015 ident: B20 article-title: Retroactive modulation of spike timing-dependent plasticity by dopamine publication-title: eLife doi: 10.7554/eLife.09685 – volume: 10 start-page: 113 year: 2009 ident: B22 article-title: State-dependent computations: spatiotemporal processing in cortical networks publication-title: Nat. Rev. Neurosci. doi: 10.1038/nrn2558 – volume: 16 start-page: 710 year: 2006 ident: B53 article-title: The role of acetylcholine in learning and memory publication-title: Curr. Opin. Neurobiol. doi: 10.1016/j.conb.2006.09.002 – volume: 4 start-page: e1000180 year: 2008 ident: B70 article-title: A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback publication-title: PLoS Comput. Biol. doi: 10.1371/journal.pcbi.1000180 – volume: 82 start-page: 3055 year: 1985 ident: B73 article-title: A mechanism for memory storage insensitive to molecular turnover: a bistable autophosphorylating kinase publication-title: Proc. Natl. Acad. Sci. U.S.A. doi: 10.1073/pnas.82.9.3055 – volume: 12 start-page: 219 ident: B32 article-title: Temporal difference learning in continuous time and space publication-title: Neural Comput. doi: 10.1162/089976600300015961 – volume: 11 start-page: e1004031 year: 2015 ident: B34 article-title: The formation of multi-synaptic connections by the interaction of synaptic and structural plasticity and their functional consequences publication-title: PLoS Comput. Biol. doi: 10.1371/journal.pcbi.1004031 – volume: 232 start-page: 351 year: 1973 ident: B12 article-title: Long-lasting potentation of synaptic transmission in the dendate area of anaesthetized rabbit following stimulation of the perforant path publication-title: J. Physiol. – volume: 16 start-page: 480 year: 1993 ident: B2 article-title: Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation publication-title: Trends Neurosci. doi: 10.1016/0166-2236(93)90081-V – volume: 12 start-page: e1005003 year: 2016 ident: B17 article-title: Prospective coding by spiking neurons publication-title: PLoS Comput. Biol. doi: 10.1371/journal.pcbi.1005003 – volume: 14 start-page: 2531 year: 2002 ident: B82 article-title: Real-time computing without stable states: a new framework for neural computation based on perturbations publication-title: Neural Comput. doi: 10.1162/089976602760407955 – volume-title: Reinforcement Learning year: 1998 ident: B142 – volume: 88 start-page: 528 year: 2015 ident: B54 article-title: Distinct eligibility traces for LTP and LTD in cortical synapses publication-title: Neuron doi: 10.1016/j.neuron.2015.09.037 – volume: 275 start-page: 1593 year: 1997 ident: B124 article-title: A neural substrate for prediction and reward publication-title: Science doi: 10.1126/science.275.5306.1593 – volume: 46 start-page: 681 year: 2005 ident: B156 article-title: Uncertainty, neuromodulation, and attention publication-title: Neuron doi: 10.1016/j.neuron.2005.04.026 – volume: 80 start-page: 1 year: 1998 ident: B122 article-title: Predictive reward signal of dopamine neurons publication-title: J. Neurophysiol. doi: 10.1152/jn.1998.80.1.1 – volume: 117 start-page: 500 year: 1952 ident: B58 article-title: A quantitative description of membrane current and its application to conduction and excitation in nerve publication-title: J Physiol doi: 10.1113/jphysiol.1952.sp004764 – volume: 91 start-page: 871 year: 1999 ident: B140 article-title: A neural network with dopamine-like reinforcement signal that learns a spatial delayed response task publication-title: Neuroscience doi: 10.1016/S0306-4522(98)00697-6 – volume: 385 start-page: 533 year: 1997 ident: B41 article-title: Synaptic tagging and long-term potentiation publication-title: Nature doi: 10.1038/385533a0 – volume: 19 start-page: 1697 year: 2016 ident: B8 article-title: Computational principles of synaptic memory consolidation publication-title: Nat. Neurosci. doi: 10.1038/nn.4401 – volume: 255 start-page: 209 year: 1992 ident: B81 article-title: Selection of intrinsic horizontal connections in the visual cortex by correlated neuronal activity publication-title: Science doi: 10.1126/science.1372754 – volume: 83 start-page: 287 year: 2000 ident: B1 article-title: Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity publication-title: Biol. Cybern. doi: 10.1007/s004220000171 – volume: 33 start-page: 9565 year: 2013 ident: B18 article-title: Matching recall and storage in sequence learning with spiking neural networks publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.4098-12.2013 – volume: 20 start-page: 8812 year: 2000 ident: B149 article-title: Stable Hebbian learning from spike timing-dependent plasticity publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.20-23-08812.2000 – volume: 132 start-page: 349 year: 1960 ident: B57 article-title: Pupil size as related to interest value of visual stimuli publication-title: Science doi: 10.1126/science.132.3423.349 – volume-title: Animal Intelligence year: 1911 ident: B146 – volume: 133 start-page: 1 year: 1972 ident: B67 publication-title: Brain Function and Adaptive Systems-a Heterostatic Theory – volume: 345 start-page: 1616 year: 2014 ident: B155 article-title: A critical time window for dopamine actions on the structural plasticity of dendritic spines publication-title: Science doi: 10.1126/science.1255514 – volume: 81 start-page: 521 year: 2014 ident: B148 article-title: Learning by the dendritic prediction of somatic spiking publication-title: Neuron doi: 10.1016/j.neuron.2013.11.030 – volume: 79 start-page: 2554 year: 1982 ident: B59 article-title: Neural networks and physical systems with emergent collective computational abilities publication-title: Proc. Natl. Acad. Sci. U.S.A. doi: 10.1073/pnas.79.8.2554 – volume: 482 start-page: 47 year: 2012 ident: B23 article-title: Conditional modulation of spike-timing-dependent plasticity for olfactory learning publication-title: Nature doi: 10.1038/nature10776 – volume: 68 start-page: 862 year: 2016 ident: B43 article-title: Active inference and learning publication-title: Neurosci. and Behav. Rev. doi: 10.1016/j.neubiorev.2016.06.022 – volume: 267 start-page: 60 year: 1992 ident: B129 article-title: The developing brain publication-title: Sci. Am. doi: 10.1038/scientificamerican0992-60 – volume: 304 start-page: 78 year: 2004 ident: B64 article-title: Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication publication-title: Science doi: 10.1126/science.1091277 – volume: 3 start-page: e221 year: 2007 ident: B48 article-title: STDP in a bistable synapse model based on CaMKII and associate signaling pathways publication-title: PLoS Comput. Biol. doi: 10.1371/journal.pcbi.0030221 – volume: 357 start-page: 1033 year: 2017 ident: B11 article-title: Behavioral time scale synaptic plasticity underlies CA1 place fields publication-title: Nature doi: 10.1126/science.aan3846 – volume: 36 start-page: 241 year: 2002 ident: B123 article-title: Getting formal with dopamine and reward publication-title: Neuron doi: 10.1016/S0896-6273(02)00967-4 – volume: 108 start-page: 19383 year: 2011 ident: B47 article-title: A triplet spike-timing dependent plasticity model generalizes the Bienenstock-Cooper-Munro rule to higher-order spatiotemporal correlations publication-title: Proc. Natl. Sci. Acad. U.S.A. doi: 10.1073/pnas.1105933108 – volume: 52 start-page: 24 year: 2007 ident: B108 article-title: The late maintenance of hippocampal LTP: requirements, phases, synaptic tagging, late associativity and implications publication-title: Neuropharmacology doi: 10.1016/j.neuropharm.2006.07.026 – volume: 412 start-page: 549 year: 2001 ident: B121 article-title: Practising orientation identification improves orientation coding in V1 neurons publication-title: Nature doi: 10.1038/35087601 – volume: 11 start-page: 127 year: 2010 ident: B42 article-title: The free-energy principle: a unified brain theory? publication-title: Nat. Rev. Neurosci. doi: 10.1038/nrn2787 – volume: 312 start-page: 101 year: 1984 ident: B26 article-title: Neurobiology-memory and molecular turnover publication-title: Nature doi: 10.1038/312101a0 – volume: 219 start-page: 736 year: 1968 ident: B27 article-title: Cortical synapses and reinforcement: a hypothesis publication-title: Nature doi: 10.1038/219736a0 – volume: 2 start-page: 230 year: 2010 ident: B120 article-title: Formal theory of creativity, fun, and intrinsic motivation (1990–2010) publication-title: IEEE Trans. Auton. Mental Dev. doi: 10.1109/TAMD.2010.2056368 – volume: 4 start-page: 1086 year: 2001 ident: B87 article-title: Dendritic spine geometry is critical for AMPA receptor expression in hippocampal CA1 pyramidal neurons publication-title: Nat. Neurosci. doi: 10.1038/nn736 – volume-title: The Hippocampus as a Cognitive Map year: 1978 ident: B99 – volume: 537 start-page: 357 year: 2016 ident: B145 article-title: Locus coeruleus and dopaminergic consolidation of everyday memory publication-title: Nature doi: 10.1038/nature19325 – volume: 106 start-page: 222 year: 2015 ident: B69 article-title: A computational analysis of the neural bases of bayesian inference publication-title: NeuroImage doi: 10.1016/j.neuroimage.2014.11.007 – volume: 2 start-page: 146 year: 2010 ident: B103 article-title: Timing is not everything: neuromodulation opens the STDP gate publication-title: Front. Synaptic Neurosci. doi: 10.3389/fnsyn.2010.00146 – volume: 30 start-page: 34 year: 2018 ident: B33 article-title: Balancing new against old information: the role of puzzlement surprise in learning publication-title: Neural Comput. doi: 10.1162/neco_a_01025 – volume: 18 start-page: 1318 year: 2006 ident: B104 article-title: Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning publication-title: Neural Comput. doi: 10.1162/neco.2006.18.6.1318 – volume: 19 start-page: 2881 year: 2007 ident: B16 article-title: Learning real-world stimuli in a neural network with spike-driven synaptic dynamics publication-title: Neural Comput. doi: 10.1162/neco.2007.19.11.2881 – volume: 5 start-page: 39 year: 2011 ident: B85 article-title: A bayesian foundation for individual learning under uncertainty publication-title: Front. Hum. Neurosci. doi: 10.3389/fnhum.2011.00039 – volume: 103 start-page: 15224 year: 2006 ident: B80 article-title: Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity publication-title: Proc. Natl. Acad. Sci. U.S.A. doi: 10.1073/pnas.0505220103 – volume: 15 start-page: 507 year: 2002 ident: B109 article-title: Dopamine-dependent plasticity of corticostriatal synapses publication-title: Neural Netw. doi: 10.1016/S0893-6080(02)00045-X – volume: 86 start-page: 364 year: 2001 ident: B117 article-title: Equilibrium properties of temporally asymmetric Hebbian plasticity publication-title: Phys. Rev. Lett. doi: 10.1103/PhysRevLett.86.364 – volume: 7 start-page: 967 year: 2006 ident: B106 article-title: The short-latency dopamine signal: a role in discovering novel actions? publication-title: Nat. Rev. Neurosci. doi: 10.1038/nrn2022 – volume: 395 start-page: 37 year: 1998 ident: B158 article-title: A critical window for cooperation and competition among developing retinotectal synapses publication-title: Nature doi: 10.1038/25665 – volume: 17 start-page: 2176 year: 2005 ident: B112 article-title: Attention-gated reinforcement learning of internal representations for classification publication-title: Neural Comput. doi: 10.1162/0899766054615699 – volume: 193 start-page: 1141 year: 1976 ident: B137 article-title: The effect of stimulus sequence on the waveform of the cortical event-related potential publication-title: Science doi: 10.1126/science.959831 – volume: 63 start-page: 544 year: 2009 ident: B141 article-title: Generating coherent patterns of activity from chaotic neural networks publication-title: Neuron doi: 10.1016/j.neuron.2009.07.018 – volume: 11 start-page: e1004060 year: 2015 ident: B115 article-title: How attention can create synaptic tags for the learning of working memories in sequential tasks publication-title: PLoS Comput. Biol. doi: 10.1371/journal.pcbi.1004060 – volume-title: Reinforcement Learning: an introduction year: 2018 ident: B143 – volume: 8 start-page: e1002689 year: 2012 ident: B29 article-title: Spike-timing dependence of structural plasticity explains cooperative synapse formation in the neocortex publication-title: PLoS Comput. Biol. doi: 10.1371/journal.pcbi.1002689 – volume: 50 start-page: 381 year: 1996 ident: B92 article-title: The basal ganglia: focused selection and inhibition of competing motor programs publication-title: Progr. Neurobiol. doi: 10.1016/S0301-0082(96)00042-1 – year: 2017 ident: B21 article-title: Sequential neuromodulation of hebbian plasticity offers mechanism for effective reward-based navigation publication-title: eLife doi: 10.7554/eLife.27756 – volume: 8 start-page: 1704 year: 2005 ident: B28 article-title: Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control publication-title: Nat. Neurosci. doi: 10.1038/nn1560 – volume: 4 start-page: 229 year: 1985 ident: B6 article-title: Learning by statistical cooperation of self-interested neuron-like computing elements publication-title: Hum. Neurobiol. – volume: 358 start-page: 829 year: 2003 ident: B75 article-title: Long-term potentiation: outstanding questions and attempted synthesis publication-title: Phil. Trans. R. Soc. Lond B Biol. Sci. doi: 10.1098/rstb.2002.1242 – volume: 91 start-page: 377 year: 2009 ident: B100 article-title: Response acquisition by humans with delayed reinforcement publication-title: J. Exp. Anal. Behav. doi: 10.1901/jeab.2009.91-377 – volume: 37 start-page: 92 year: 2016 ident: B151 article-title: Brain structure and dynamics across scales: in search of rules publication-title: Curr. Opin. Neurobiol. doi: 10.1016/j.conb.2015.12.010 – volume: 22 start-page: 123 year: 1996 ident: B134 article-title: Reinforcement learning with replacing eligibility traces publication-title: Mach. Learn. doi: 10.1007/BF00114726 – volume: 28 start-page: 1396 year: 2018 ident: B30 article-title: Multicontact co-operativity in spike-timing-dependent structural plasticity stabilizes networks publication-title: Cereb. Cortex doi: 10.1093/cercor/bhx339 – volume-title: Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex. year: 1927 ident: B102 – volume: 23 start-page: 472 year: 2000 ident: B125 article-title: Neuronal coding of prediction errors publication-title: Ann. Rev. Neurosci. doi: 10.1146/annurev.neuro.23.1.473 – volume: 7 start-page: 13276 year: 2016 ident: B72 article-title: Random synaptic feedback weights support error backpropagation for deep learning publication-title: Nat. Commun. doi: 10.1038/ncomms13276 – volume: 5 start-page: 171 year: 1995 ident: B19 article-title: Simulation of spatial learning in the Morris water maze by a neural network model of the hippocampal-formation and nucleus accumbens publication-title: Hippocampus doi: 10.1002/hipo.450050304 – volume: 111 start-page: 815 year: 2002 ident: B50 article-title: Neuromodulatory transmitter systems in the cortex and their role in cortical plasticity publication-title: Neuroscience doi: 10.1016/S0306-4522(02)00026-X – volume: 11 start-page: 265 year: 2007 ident: B101 article-title: Intrinsic motivation systems for autonomous mental development publication-title: IEEE Trans. Evol. Comput. doi: 10.1109/TEVC.2006.890271 – volume: 80 start-page: 704 year: 2013 ident: B60 article-title: AMPARs and synaptic plasticity: the last 25 years publication-title: Neuron doi: 10.1016/j.neuron.2013.10.025 – volume: 27 start-page: 7476 year: 2007 ident: B94 article-title: Induction of long-term memory by exposure to novelty requires protein synthesis: Evidence for a behavioral tagging publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.1083-07.2007 – volume: 5 start-page: e1000259 year: 2009 ident: B4 article-title: State based model of long-term potentiation and synaptic tagging and capture publication-title: PLoS Comput. Biol. doi: 10.1371/journal.pcbi.1000259 – volume: 383 start-page: 76 year: 1996 ident: B46 article-title: A neuronal learning rule for sub-millisecond temporal coding publication-title: Nature doi: 10.1038/383076a0 – volume: 9 start-page: e1003024 year: 2013 ident: B40 article-title: Reinforcement learning using continuous time actor-critic framework with spiking neurons publication-title: PLoS Comput. Biol. doi: 10.1371/journal.pcbi.1003024 – volume: 86 start-page: 9574 year: 1989 ident: B74 article-title: A mechanism for Hebb and anti-Hebb processes underlying learning and memory publication-title: Proc. Natl. Acad. Sci. U.S.A. doi: 10.1073/pnas.86.23.9574 – volume: 15 start-page: 267 year: 1982 ident: B98 article-title: A simplified neuron model as a principal component analyzer publication-title: J. Math. Biol. doi: 10.1007/BF00275687 – start-page: 1928 volume-title: Proceedings of the 33rd International Conference on Machine Learning year: 2016 ident: B93 article-title: Asynchronous methods for deep reinforcement learning – volume: 13 start-page: 35 year: 2001 ident: B126 article-title: An algorithm for modifying neurotransmitter release probability based on pre- and postsynaptic spike timing publication-title: Neural Comput. doi: 10.1162/089976601300014628 – volume: 6 start-page: 359 year: 2013 ident: B68 article-title: A model-based approach to trial-by-trial p300 amplitude fluctuations publication-title: Front. Hum. Neurosci. doi: 10.3389/fnhum.2012.00359 – volume: 361 start-page: 31 year: 1993 ident: B14 article-title: A synaptic model of memory: long-term potentiation in the hippocampus publication-title: Nature doi: 10.1038/361031a0 – volume: 7 start-page: 37 year: 2013 ident: B78 article-title: Learning and exploration in action-perception loops publication-title: Front. Neural Circ. doi: 10.3389/fncir.2013.00037 – volume: 5 start-page: 1471 year: 2004 ident: B49 article-title: Variance reduction techniques for gradient estimates in reinforcement learning publication-title: J. Machine Learn. Res/ – start-page: 1458 volume-title: Proceedings of the International Joint Conference on Neural Networks year: 1991 ident: B118 article-title: Curious model-building control systems – volume: 32 start-page: 1149 year: 2001 ident: B135 article-title: Rate, timing, and cooperativity jointly determine cortical synaptic plasticity publication-title: Neuron doi: 10.1016/S0896-6273(01)00542-6 – volume: 15 start-page: 1511 year: 2003 ident: B63 article-title: Relating STDP to BCM publication-title: Neural Comput. doi: 10.1162/089976603321891783 – volume: 10 start-page: 732 ident: B31 article-title: Complementary roles of basal ganglia and cerebellum in learning and motor control publication-title: Curr. Opin. Neurobiol. doi: 10.1016/S0959-4388(00)00153-7 – volume: 33 start-page: 4693 year: 2013 ident: B35 article-title: Diversity and homogeneity in responses of midbrain dopamine neurons publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.3886-12.2013 – volume: 86 start-page: 1478 year: 2015 ident: B105 article-title: Learning enhances sensory and multiple non-sensory representations in primary visual cortex publication-title: Neuron doi: 10.1016/j.neuron.2015.05.037 – volume: 8 start-page: 38 year: 2014 ident: B110 article-title: Stochastic variational learning in recurrent spiking networks publication-title: Front. Comput. Neurosci. doi: 10.3389/fncom.2014.00038 – volume: 372 start-page: 20160260 year: 2017 ident: B76 article-title: Glutamatergic synapses are structurally and biochemically complex because of multiple plasticity processes: long-term potentiation, long-term depression, short-term potentiation and scaling publication-title: Phil. Trans. Roy. Soc. B doi: 10.1098/rstb.2016.0260 – volume: 30 start-page: 12366 year: 2010 ident: B96 article-title: An approximately bayesian delta-rule model explains the dynamics of belief updating in a changing environment publication-title: J. Neurosci. doi: 10.1523/JNEUROSCI.0822-10.2010 – volume: 357 start-page: 1133 year: 2015 ident: B10 article-title: Conjunctive input processing drives feature selectivity in hippocampal CA1 neurons publication-title: Nat. Neurosci. doi: 10.1038/nn.4062 – volume: 12 start-page: 250 year: 2009 ident: B147 article-title: Reinforcement learning in populations of spiking neurons publication-title: Nat. Neurosci. doi: 10.1038/nn.2264 – volume-title: Hebbian Synaptic Modification in Spiking Neurons That Learn year: 1999 ident: B5 – volume: 31 start-page: 236 year: 2000 ident: B90 article-title: Basal ganglia and cerebellar loops: motor and cognitive circuits publication-title: Brain Res. Rev. doi: 10.1016/S0165-0173(99)00040-5 – volume: 14 start-page: 64 year: 2010 ident: B113 article-title: Perceptual learning rules based on reinforcers and attention publication-title: Trends Cogn. Sci. doi: 10.1016/j.tics.2009.11.005 – volume: 82 start-page: 444 year: 2014 ident: B15 article-title: Structural and molecular remodeling of dendritic spine substructures during long-term potentation publication-title: Neuron doi: 10.1016/j.neuron.2014.03.021 – volume: 275 start-page: 213 year: 1997 ident: B83 article-title: Regulation of synaptic efficacy by coincidence of postysnaptic AP and EPSP publication-title: Science doi: 10.1126/science.275.5297.213 – volume: 3 start-page: 919 year: 2000 ident: B136 article-title: Competitive Hebbian learning through spike-time-dependent synaptic plasticity publication-title: Nat. Neurosci. doi: 10.1038/78829 – volume: 6 start-page: 100 year: 1994 ident: B91 article-title: The role of constraints in hebbian learning publication-title: Neural Comput. doi: 10.1162/neco.1994.6.1.100 – volume: 88 start-page: 135 year: 1981 ident: B144 article-title: Towards a modern theory of adaptive networks: expectation and prediction publication-title: Psychol. Rev. doi: 10.1037/0033-295X.88.2.135
SSID	ssj0062654
Score	2.5927157
SecondaryResourceType	review_article
Snippet	Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in...
SourceID	doaj pubmedcentral proquest pubmed crossref
SourceType	Open Website Open Access Repository Aggregation Database Index Database Enrichment Source
StartPage	53
SubjectTerms	Behavioral plasticity Brain - physiology Computer science Dopamine Electrophysiological Phenomena - physiology eligibility trace Experiments hebb rule Humans Learning Learning - physiology Memory Models, Biological Neural networks Neuromodulation neuromodulators Neuronal Plasticity - physiology Neurons - physiology Neuroscience Neurosciences Punishment Reinforcement reinforcement learning surprise Synaptic plasticity synaptic tagging
SummonAdditionalLinks	– databaseName: ProQuest Central dbid: BENPR link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1Lb9QwEB7BlgMXCi2PhYKMhJA4RJuHncRcUBftqqfVqipSb5HjR1kJkrIPpIo_z4zjhC5CvXCNbcnKjOcb2-PvA3ince-fK7SAQzyNEKHjSCJMRVqUpePCplxoLzZRLBbl5aVchgO3TSir7GOiD9Sm1XRGPklTmVO2kpSfrn9EpBpFt6tBQuM-HBBTGR_BwXS2WJ73sRizdcG7y0ncismJa_SKSEATKqCMRbYHRp6z_1-J5t_1krcAaH74v1N_DI9C6slOO195AvdscwTHpw1uu7_fsPfMF4P6U_YjOOzVHlhY_Mfwa0bFy76W9oYhxGGAYaoxbIn5N5Vm49e2YdPh2T-j1yU4HBFo85HNbikJMJISxbSftY4tbHtmayI-ZxfoVjaaewEgFnhfr9j5Dsc_hS_z2cXnsyhIN6CRRb6Nasfr3PLUEX2YxJyYG5caZ9BIViRWW2PrMuOFNrbg0giHcSA2jistVFwWOnsGo6Zt7AtgOYKrqlVakHqgE5k0Sme4z8u5TtGbkjFMehtWOvCak7zGtwr3N2T1ylu9IqtX3upj-DCMuO44Pe7oOyW3GPoRG7f_0K6vqrC4K5dLp2wq66y0PE9Ujd5fqxqxRGibZXYMJ71jVCFEbKo_XjGGt0MzLm66sVGNbXfYhzCA5xhlx_C888FhJhiZSQsBW4o979yb6n5Ls_rqCcTzuJCYur28e1qv4CH9h-4g-wRG2_XOvoYH-ud2tVm_CSvtN_D6Nnk priority: 102 providerName: ProQuest
Title	Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules
URI	https://www.ncbi.nlm.nih.gov/pubmed/30108488 https://www.proquest.com/docview/2296139718 https://www.proquest.com/docview/2088746048 https://pubmed.ncbi.nlm.nih.gov/PMC6079224 https://doaj.org/article/f69fae29b38e461ab6a8bab5385ce33e
Volume	12
WOSCitedRecordID	wos000440325400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals customDbUrl: eissn: 1662-5110 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0062654 issn: 1662-5110 databaseCode: DOA dateStart: 20070101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 1662-5110 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0062654 issn: 1662-5110 databaseCode: M~E dateStart: 20070101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre – providerCode: PRVPQU databaseName: Biological Science Database customDbUrl: eissn: 1662-5110 dateEnd: 20211231 omitProxy: false ssIdentifier: ssj0062654 issn: 1662-5110 databaseCode: M7P dateStart: 20071102 isFulltext: true titleUrlDefault: http://search.proquest.com/biologicalscijournals providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Central customDbUrl: eissn: 1662-5110 dateEnd: 20211231 omitProxy: false ssIdentifier: ssj0062654 issn: 1662-5110 databaseCode: BENPR dateStart: 20071102 isFulltext: true titleUrlDefault: https://www.proquest.com/central providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Publicly Available Content Database customDbUrl: eissn: 1662-5110 dateEnd: 20211231 omitProxy: false ssIdentifier: ssj0062654 issn: 1662-5110 databaseCode: PIMPY dateStart: 20071102 isFulltext: true titleUrlDefault: http://search.proquest.com/publiccontent providerName: ProQuest – providerCode: PRVPQU databaseName: Science Database customDbUrl: eissn: 1662-5110 dateEnd: 20211231 omitProxy: false ssIdentifier: ssj0062654 issn: 1662-5110 databaseCode: M2P dateStart: 20071102 isFulltext: true titleUrlDefault: https://search.proquest.com/sciencejournals providerName: ProQuest
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3Ni9QwFH_o6sGLqOtHdR0iiOChTD-StPG2Ix3Www5lXWE8lTRNdEBb2ZkRFsG_3ffSTpkR0YuXHJp0yOT3PtvX3wN4aTD3lxoRcOhPQ_TQUajQTYVG5LnjwiZcGN9sIlss8uVSlXutvqgmrKcH7g9u6qRy2iaqTnPLZaxr_OVa16inwtg0tWR9MerZJVO9DcYoXfD-pSSmYGrqWrMi8s-YCicjkR44Ic_V_6cA8_c6yT3HM78Hd4eIkZ32O70PN2z7AI5PW8yWv16zV8zXcPqH48fwo6ACY1_ves3QDaERYLptWIkxMpVP49WuZbPx03xGX4Cw94iTXb9hxR7bP6N2nxias86xhe3ObE3k5OwSobfh3DfpYQM36yd2scX7H8KHeXH59iwc2isgEEJuwtrxWlqeOKL4Uhi38sYljWviWFkRW2MbW-cpz0xjM64a4VBXo8ZxbYSO8sykj-Co7Vr7BJhEB6hrnWTU4c-JVDXapJiLSW4SRDwOYLo778oM3OPUAuNLhTkIIVR5hCpCqPIIBfB6vONbz7vxl7UzgnBcR4zZ_gLKUTXIUfUvOQrgZCcA1aDG6ypJlKQQOc4DeDFOowLSWxXd2m6La8hOc4mWMIDHvbyMO0HrSf0KcCY7kKSDrR7OtKvPnuRbRpnC8Orp__hvz-AOnVb_SPoEjjZXW_scbpvvm9X6agI3s2U-gVuzYlFeTLwe4XielDRmfvxZ4Hz57rz8-AuBDSlB
linkProvider	Directory of Open Access Journals
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V3fb9MwED6NgQQvDDZ-FAYYCZB4iNo4dhIjIbRBp04bVYWKtLfgOPaoBMnoD1DF_8TfyJ2TlBWhve2B19huI-e7--7iy30Azwzm_rHGJ-CQTwNk6F6gkKYCI9PUCWm5kMaLTSTDYXpyokYb8Kv9FobKKluf6B11URl6R97lXMUUrYTpm7NvAalG0elqK6FRw-LILn9gyjZ7ffgOn-9zzg_647eDoFEVwP-X8TzInchjK7ijzlYKwzVROF64IgyVlaE1trB5GonEFDYRqpAOIdornNBG6l6amAh_9wpcxTCCp75UcNR6fswNpKiPQjHxU11Xmgm1HA2pXLMnozXq8woB_wpr_67OPEd3B1v_20bdgptNYM32aku4DRu23IadvVLPq69L9oL5Uld_hrANW62WBWtc2w787FNptq8UXjIkcHSfTJcFG2F2QYXneLUq2f6qqQGjb2dwOfLr7BXrn9NJYCSUikkNqxwb2mpgc2rrzsZoNDY48PJGrOlqe8o-LHD9Hfh4KTtzFzbLqrT3gcUYOuhc84S0EZ2MVKFNhFlsLAxHWwk70G0xk5mmazuJh3zJMHsjlGUeZRmhLPMo68DL1YqzumPJBXP3CYaredRr3F-opqdZ47oyFyunLVd5lFoRhzpH2851jkwpjY0i24HdFohZ4wBn2R8UduDpahhdF51H6dJWC5xDDCdi5JAO3Ksxv7oT5B1SesCRZM0a1m51faScfPbt0eNeojAwfXDxbT2B64Px--Ps-HB49BBu0J7Ur-x3YXM-XdhHcM18n09m08fexhl8umxb-Q0PA5S7
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Nb9QwEB2VghAXCi0fCwWMBEgcot04dhIjIdTSXbUqWq1QkXpLHccuK7VJ2Q_Qin_Gr2PGSZYuQr31wDWOI8t5M28mnswDeGUw9481vgGHfBogQ_cChTQVGJmmTkjLhTRebCIZDtPjYzVag1_tvzBUVtn6RO-oi8rQN_Iu5yqmaCVMu64pixjtDT5cfAtIQYpOWls5jRoih3bxA9O36fuDPXzXrzkf9I8-7geNwgCuRcazIHcij63gjrpcKQzdROF44YowVFaG1tjC5mkkElPYRKhCOoRrr3BCG6l7aWIifO4NuJkIfBqVDfJRywKYJ0hRH4tiEqi6rjRjaj8aUulmT0YrNOjVAv4V4v5dqXmJ-gYb__Om3YO7TcDNdmoLuQ9rttyErZ1Sz6rzBXvDfAmsP1vYhI1W44I1Lm8LfvapZNtXEC8YEju6VabLgo0w66CCdLxalWx32eyA0T81OB15d_qO9S_pJzASUMVkh1WODW21b3Nq986O0JhsMPCyR6zpdnvKPs9x_gP4ci078xDWy6q0j4HFGFLoXPOENBOdjFShTYTZbSwMRxsKO9Bt8ZOZpps7iYqcZZjVEeIyj7iMEJd5xHXg7XLGRd3J5Ip7dwmSy_uoB7m_UE1Os8alZS5WTluu8ii1Ig51jjaf6xwZVBobRbYD2y0os8YxTrM_iOzAy-UwujQ6p9KlreZ4DzGfiJFbOvCoxv9yJchHpACBI8mKZawsdXWkHH_1bdPjXqIwYH1y9bJewG00kezTwfDwKdyhLam_5G_D-mwyt8_glvk-G08nz725Mzi5blP5DStenXc
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Eligibility+Traces+and+Plasticity+on+Behavioral+Time+Scales%3A+Experimental+Support+of+NeoHebbian+Three-Factor+Learning+Rules&rft.jtitle=Frontiers+in+neural+circuits&rft.au=Gerstner%2C+Wulfram&rft.au=Lehmann%2C+Marco&rft.au=Liakoni%2C+Vasiliki&rft.au=Corneil%2C+Dane&rft.date=2018-07-31&rft.issn=1662-5110&rft.eissn=1662-5110&rft.volume=12&rft_id=info:doi/10.3389%2Ffncir.2018.00053&rft.externalDBID=n%2Fa&rft.externalDocID=10_3389_fncir_2018_00053
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1662-5110&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1662-5110&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1662-5110&client=summon