Does BERT really agree ? Fine-grained Analysis of Lexical Dependence on a Syntactic Task

Although transformer-based Neural Language Models demonstrate impressive performance on a variety of tasks, their generalization abilities are not well understood. They have been shown to perform strongly on subject-verb number agreement in a wide array of settings, suggesting that they learned to t...

Full description

Bibliographic Details

Published in:	arXiv.org
Main Authors:	Lasri, Karim, Lenci, Alessandro, Poibeau, Thierry
Format:	Paper
Language:	English
Published:	Ithaca Cornell University Library, arXiv.org 14.04.2022
Subjects:	Sentences
ISSN:	2331-8422
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!