Calibrating Multi-modal Representations: A Pursuit of Group Robustness without Annotations

Fine-tuning pre-trained vision-language models, like CLIP, has yielded success on diverse downstream tasks. However, several pain points persist for this paradigm: (i) directly tuning entire pre-trained models becomes both time-intensive and computationally costly. Additionally, these tuned models t...

Full description

Bibliographic Details

Published in:	Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) Vol. 2024; pp. 26140 - 26150
Main Authors:	You, Chenyu, Mint, Yifei, Dai, Weicheng, Sekhon, Jasjeet S., Staib, Lawrence, Duncan, James S.
Format:	Conference Proceeding Journal Article
Language:	English
Published:	United States IEEE 01.06.2024
Subjects:	Annotations Benchmark testing Computational modeling Contrastive learning Group Robustness; Multi-Modal Learning; Spurious Correlations Refining Training data Visualization
ISSN:	1063-6919, 1063-6919
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!