Curiosity-driven exploration: foundations in neuroscience and computational modeling

Exploratory behaviors are central to the study of curiosity, since they allow us to infer an otherwise hidden state of being curious from quantitative, experimental observations.Reactive orienting behaviors reflect a fundamental form of curiosity and are driven by the immediate novelty and/or surpri...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Trends in neurosciences (Regular ed.) Ročník 46; číslo 12; s. 1054 - 1066
Hlavní autoři: Modirshanechi, Alireza, Kondrakiewicz, Kacper, Gerstner, Wulfram, Haesler, Sebastian
Médium: Journal Article
Jazyk:angličtina
Vydáno: England Elsevier Ltd 01.12.2023
Témata:
ISSN:0166-2236, 1878-108X, 1878-108X
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Exploratory behaviors are central to the study of curiosity, since they allow us to infer an otherwise hidden state of being curious from quantitative, experimental observations.Reactive orienting behaviors reflect a fundamental form of curiosity and are driven by the immediate novelty and/or surprise of stimuli.Operant tasks probe curiosity by offering experimental subjects explicit action choices to collect information, in a manner that is either neutral or costly/useful with regards to overall gains/losses.Recently developed computational models of curiosity, based on intrinsically motivated reinforcement learning, describe different expressions of curiosity in a unified theoretical framework. Curiosity refers to the intrinsic desire of humans and animals to explore the unknown, even when there is no apparent reason to do so. Thus far, no single, widely accepted definition or framework for curiosity has emerged, but there is growing consensus that curious behavior is not goal-directed but related to seeking or reacting to information. In this review, we take a phenomenological approach and group behavioral and neurophysiological studies which meet these criteria into three categories according to the type of information seeking observed. We then review recent computational models of curiosity from the field of machine learning and discuss how they enable integrating different types of information seeking into one theoretical framework. Combinations of behavioral and neurophysiological studies along with computational modeling will be instrumental in demystifying the notion of curiosity. Curiosity refers to the intrinsic desire of humans and animals to explore the unknown, even when there is no apparent reason to do so. Thus far, no single, widely accepted definition or framework for curiosity has emerged, but there is growing consensus that curious behavior is not goal-directed but related to seeking or reacting to information. In this review, we take a phenomenological approach and group behavioral and neurophysiological studies which meet these criteria into three categories according to the type of information seeking observed. We then review recent computational models of curiosity from the field of machine learning and discuss how they enable integrating different types of information seeking into one theoretical framework. Combinations of behavioral and neurophysiological studies along with computational modeling will be instrumental in demystifying the notion of curiosity.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
ObjectType-Review-3
content type line 23
ISSN:0166-2236
1878-108X
1878-108X
DOI:10.1016/j.tins.2023.10.002