中文
相关论文

相关论文: Adaptive Debiasing Tsallis Entropy for Test-Time A…

200 篇论文

Machine learning models must continuously self-adjust themselves for novel data distribution in the open world. As the predominant principle, entropy minimization (EM) has been proven to be a simple yet effective cornerstone in existing…

机器学习 · 统计学 2024-10-16 Qingyang Zhang , Yatao Bian , Xinke Kong , Peilin Zhao , Changqing Zhang

Although open-vocabulary classification models like Contrastive Language Image Pretraining (CLIP) have demonstrated strong zero-shot learning capabilities, their robustness to common image corruptions remains poorly understood. Through…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Sarthak Kumar Maharana , Baoming Zhang , Leonid Karlinsky , Rogerio Feris , Yunhui Guo

Test-time adaptation (TTA) methods have gained significant attention for enhancing the performance of vision-language models (VLMs) such as CLIP during inference, without requiring additional labeled data. However, current TTA researches…

机器学习 · 计算机科学 2025-10-14 Lijun Sheng , Jian Liang , Ran He , Zilei Wang , Tieniu Tan

Test-Time Adaptation (TTA) adjusts models using unlabeled test data to handle dynamic distribution shifts. However, existing methods rely on frequent adaptation and high computational cost, making them unsuitable for resource-constrained…

机器学习 · 计算机科学 2025-11-20 Hyeongheon Cha , Dong Min Kim , Hye Won Chung , Taesik Gong , Sung-Ju Lee

Deep learning models often struggle under natural distribution shifts, a common challenge in real-world deployments. Test-Time Adaptation (TTA) addresses this by adapting models during inference without labeled source data. We present the…

计算机视觉与模式识别 · 计算机科学 2026-03-23 John Turnbull , Shivam Grover , Amin Jalali , Ali Etemad

Vision-language models (VLMs) such as CLIP achieve strong zero-shot recognition but degrade significantly under \textit{temporally evolving distribution shifts} common in real-world scenarios (e.g., gradual illumination or seasonal…

计算机视觉与模式识别 · 计算机科学 2025-07-14 Shuang Cui , Jinglin Xu , Yi Li , Xiongxin Tang , Jiangmeng Li , Jiahuan Zhou , Fanjiang Xu , Fuchun Sun , Hui Xiong

Test-time adaptation (TTA) methods, which generally rely on the model's predictions (e.g., entropy minimization) to adapt the source pretrained model to the unlabeled target domain, suffer from noisy signals originating from 1) incorrect or…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Jungsoo Lee , Debasmit Das , Jaegul Choo , Sungha Choi

In density estimation task, maximum entropy model (Maxent) can effectively use reliable prior information via certain constraints, i.e., linear constraints without empirical parameters. However, reliable prior information is often…

机器学习 · 计算机科学 2010-04-08 Yuexian Hou , Tingxu Yan , Peng Zhang , Dawei Song , Wenjie Li

Mainstream test-time adaptation (TTA) techniques endeavor to mitigate distribution shifts via entropy minimization for multi-class classification, inherently increasing the probability of the most confident class. However, when encountering…

计算机视觉与模式识别 · 计算机科学 2025-02-07 Xiangyu Wu , Feng Yu , Qing-Guo Chen , Yang Yang , Jianfeng Lu

Test-time adaptation (TTA) aims to adapt a trained classifier using online unlabeled test data only, without any information related to the training procedure. Most existing TTA methods adapt the trained classifier using the classifier's…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Minguk Jang , Sae-Young Chung , Hye Won Chung

Pre-trained vision-language models such as contrastive language-image pre-training (CLIP) have demonstrated a remarkable generalizability, which has enabled a wide range of applications represented by zero-shot classification. However,…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Kazuki Adachi , Shin'ya Yamaguchi , Tomoki Hamagami

Test-time adaptation (TTA) refers to adapting a trained model to a new domain during testing. Existing TTA techniques rely on having multiple test images from the same domain, yet this may be impractical in real-world applications such as…

计算机视觉与模式识别 · 计算机科学 2024-02-19 Haoyu Dong , Nicholas Konz , Hanxue Gu , Maciej A. Mazurowski

Test-time adaptation (TTA) aims to transfer knowledge from a source model to unknown test data with potential distribution shifts in an online manner. Many existing TTA methods rely on entropy as a confidence metric to optimize the model.…

机器学习 · 计算机科学 2025-10-07 Chang'an Yi , Xiaohui Deng , Shuaicheng Niu , Yan Zhou

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

机器学习 · 计算机科学 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu

Vision-Language Models (VLMs) such as CLIP achieve strong zero-shot recognition by comparing image embeddings to text-derived class prototypes. However, under domain shift, they suffer from feature drift, class-prior mismatch, and severe…

计算机视觉与模式识别 · 计算机科学 2025-11-13 Byunghyun Kim

Machine learning methods strive to acquire a robust model during the training process that can effectively generalize to test samples, even in the presence of distribution shifts. However, these methods often suffer from performance…

机器学习 · 计算机科学 2024-12-13 Jian Liang , Ran He , Tieniu Tan

Minimizing prediction uncertainty on unlabeled data is a key factor to achieve good performance in semi-supervised learning (SSL). The prediction uncertainty is typically expressed as the \emph{entropy} computed by the transformed…

机器学习 · 计算机科学 2021-12-16 Jing Li , Yuangang Pan , Ivor W. Tsang

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model…

机器学习 · 计算机科学 2023-01-12 Taesik Gong , Jongheon Jeong , Taewon Kim , Yewon Kim , Jinwoo Shin , Sung-Ju Lee

Continual Test-Time Adaptation (CTTA) is proposed to migrate a source pre-trained model to continually changing target distributions, addressing real-world dynamism. Existing CTTA methods mainly rely on entropy minimization or…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Jiaming Liu , Ran Xu , Senqiao Yang , Renrui Zhang , Qizhe Zhang , Zehui Chen , Yandong Guo , Shanghang Zhang

Recently, Miller et al. (2021) and Baek et al. (2022) empirically demonstrated strong linear correlations between in-distribution (ID) versus out-of-distribution (OOD) accuracy and agreement. These trends, coined accuracy-on-the-line (ACL)…

机器学习 · 计算机科学 2024-11-11 Eungyeup Kim , Mingjie Sun , Christina Baek , Aditi Raghunathan , J. Zico Kolter