In EDS ansehen

Neural language model gradients predict event-related brain potentials

Gespeichert in:
Bibliographische Detailangaben
Titel: Neural language model gradients predict event-related brain potentials
Autoren: Stefan L. Frank
Publication Status: Preprint
Verlagsinformationen: Center for Open Science, 2024.
Publikationsjahr: 2024
Schlagwörter: Computational Linguistics, Psycholinguistics and Neurolinguistics, prediction error, event-related brain potentials, Cognitive Psychology, P600, LSTM model, Linguistics, N400, sentence processing, Social and Behavioral Sciences, error propagation, Language
Beschreibung: Fitz & Chang (2019) argue that event-related brain potentials during sentence comprehension result from the detection and incorporation of word-prediction error. Specifically, the N400 component would correlate with prediction error while the P600 component would be indicative of error backpropagation in the language system. The current work evaluates this hypothesis on a corpus of EEG data recorded during naturalistic sentence reading. Word-prediction error and backpropagated error were estimated by an LSTM language model that processed the same 205 English sentences as the human participants. At each word, the word's surprisal and the total gradient of recurrent-layer connections were collected for comparison to the sizes of the N400 and P600 components. Consistent with the theory, higher surprisal resulted in stronger N400 while higher gradient resulted in stronger P600, and ERPs on content words were more sensitive to surprisal whereas ERPs on function words were more sensitive to gradient. However, a detailed analysis of the neural signal's time course indicates that the apparent P600 effect could be interpreted as a reversed N400 effect.
Publikationsart: Article
DOI: 10.31234/osf.io/cx3h6
DOI: 10.7275/scil.2215
Rights: CC BY
Dokumentencode: edsair.doi.dedup.....c89d1c10c92e54ff4501b58b36e23c2c
Datenbank: OpenAIRE
Beschreibung
Abstract:Fitz & Chang (2019) argue that event-related brain potentials during sentence comprehension result from the detection and incorporation of word-prediction error. Specifically, the N400 component would correlate with prediction error while the P600 component would be indicative of error backpropagation in the language system. The current work evaluates this hypothesis on a corpus of EEG data recorded during naturalistic sentence reading. Word-prediction error and backpropagated error were estimated by an LSTM language model that processed the same 205 English sentences as the human participants. At each word, the word's surprisal and the total gradient of recurrent-layer connections were collected for comparison to the sizes of the N400 and P600 components. Consistent with the theory, higher surprisal resulted in stronger N400 while higher gradient resulted in stronger P600, and ERPs on content words were more sensitive to surprisal whereas ERPs on function words were more sensitive to gradient. However, a detailed analysis of the neural signal's time course indicates that the apparent P600 effect could be interpreted as a reversed N400 effect.
DOI:10.31234/osf.io/cx3h6