Probabilistic Contrastive Test-Time Adaptation

Test-time adaptation (TTA) enhances generalization against out-of-distribution data during inference. Recent advances in TTA leverage some techniques such as contrastive learning and entropy minimization to improve the discriminability and robustness of models in target domains. However, existing me...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Proceedings of the ... IEEE International Conference on Acoustics, Speech and Signal Processing (1998) s. 1 - 5
Hlavní autoři: You, Linjing, Lu, Jiabao, Huang, Xiayuan
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 06.04.2025
Témata:
Adaptation models
Contrastive learning
Distribution Shifts
Entropy
Heavily-tailed distribution
Label Shifts
Minimization
Probabilistic Contrastive Learning
Probabilistic logic
Robustness
Signal processing
Signal processing algorithms
Speech processing
Test-Time Adaptation
ISSN:2379-190X
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Test-time adaptation (TTA) enhances generalization against out-of-distribution data during inference. Recent advances in TTA leverage some techniques such as contrastive learning and entropy minimization to improve the discriminability and robustness of models in target domains. However, existing methods often overlook simultaneous distribution shifts of sample and label, such as long-tail distributions, and contrastive learning approaches may require substantial storage for sample pairs. In this paper, we propose a novel Probabilistic Contrastive Test-time Adaptation (PCTA) method based on Expectation Maximization (EM), which is used to estimate the von Mises Fisher (vMF) distribution of test samples to capture both sample distribution and class proportions. The estimated distributions are used for probabilistic contrastive learning to adapt feature representations and optimize classification through class-weighted entropy minimization. Experimental results show that PCTA significantly enhances the performance across various distribution shifts and outperforms state-of-the-art methods in different scenarios involving both sample and label shifts. Code is available at https://github.com/youlj109/PCTA.
ISSN:2379-190X
DOI:10.1109/ICASSP49660.2025.10890260