Knowledge distillation: A good teacher is patient and consistent

There is a growing discrepancy in computer vision between large-scale models that achieve state-of-the-art performance and models that are affordable in practical applications. In this paper we address this issue and significantly bridge the gap between these two types of models. Throughout our empi...

Celý popis

Podrobná bibliografie

Vydáno v:	Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) s. 10915 - 10924
Hlavní autoři:	Beyer, Lucas, Zhai, Xiaohua, Royer, Amelie, Markeeva, Larisa, Anil, Rohan, Kolesnikov, Alexander
Médium:	Konferenční příspěvek
Jazyk:	angličtina
Vydáno:	IEEE 01.06.2022
Témata:	Computational modeling Computer vision Data models Deep learning architectures and techniques; Efficient learning and inferences; Machine learning; Optimization methods; Representation learning Image coding Manifolds Schedules Training
ISSN:	1063-6919
On-line přístup:	Získat plný text
Tagy:	Přidat tag Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!