Dopamine blockade impairs the exploration-exploitation trade-off in rats

In a volatile environment where rewards are uncertain, successful performance requires a delicate balance between exploitation of the best option and exploration of alternative choices. It has theoretically been proposed that dopamine contributes to the control of this exploration-exploitation trade...

Celý popis

Uloženo v:

Podrobná bibliografie
Vydáno v:	Scientific reports Ročník 9; číslo 1; s. 6770 - 14
Hlavní autoři:	Cinotti, François, Fresno, Virginie, Aklil, Nassim, Coutureau, Etienne, Girard, Benoît, Marchand, Alain R., Khamassi, Mehdi
Médium:	Journal Article
Jazyk:	angličtina
Vydáno:	London Nature Publishing Group UK 01.05.2019 Nature Publishing Group Nature Portfolio
Témata:	631/378/1595/1396 631/378/1788 631/378/2649/1409 Animals Artificial Intelligence Cognitive science Computer applications Computer Science Decision Making Dopamine Dopamine - chemistry Dopamine - metabolism Dopamine Antagonists - pharmacology Dopamine receptors Environmental changes Exploitation Exploratory Behavior - drug effects Exploratory Behavior - physiology Humanities and Social Sciences Learning Male Mathematical models Models, Theoretical multidisciplinary Neural and Evolutionary Computing Neuroscience Probability Learning Rats Rats, Long-Evans Reinforcement Reward Robotics Scaling Science Science (multidisciplinary)
ISSN:	2045-2322, 2045-2322
On-line přístup:	Získat plný text
Tagy:	Přidat tag Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!

Popis
Shrnutí:	In a volatile environment where rewards are uncertain, successful performance requires a delicate balance between exploitation of the best option and exploration of alternative choices. It has theoretically been proposed that dopamine contributes to the control of this exploration-exploitation trade-off, specifically that the higher the level of tonic dopamine, the more exploitation is favored. We demonstrate here that there is a formal relationship between the rescaling of dopamine positive reward prediction errors and the exploration-exploitation trade-off in simple non-stationary multi-armed bandit tasks. We further show in rats performing such a task that systemically antagonizing dopamine receptors greatly increases the number of random choices without affecting learning capacities. Simulations and comparison of a set of different computational models (an extended Q-learning model, a directed exploration model, and a meta-learning model) fitted on each individual confirm that, independently of the model, decreasing dopaminergic activity does not affect learning rate but is equivalent to an increase in random exploration rate. This study shows that dopamine could adapt the exploration-exploitation trade-off in decision-making when facing changing environmental contingencies.
Bibliografie:	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23
ISSN:	2045-2322 2045-2322
DOI:	10.1038/s41598-019-43245-z