中文
相关论文

相关论文: REALM: Robust Entropy Adaptive Loss Minimization f…

200 篇论文

High resolution micro-ultrasound has demonstrated promise in real-time prostate cancer detection, with deep learning becoming a prominent tool for learning complex tissue properties reflected on ultrasound. However, a significant roadblock…

Unsupervised tabular anomaly detection methods typically learn feature patterns from normal samples during training and subsequently identify samples that deviate from these patterns as anomalies during testing. However, in practical…

机器学习 · 计算机科学 2026-05-12 Wei Huang , Hezhe Qiao , Kailai Zhang , Zaisheng Ye , Yu-Ming Shang , Xiangling Fu

Test-time adaptation (TTA) has emerged as a promising solution to address performance decay due to unforeseen distribution shifts between training and test data. While recent TTA methods excel in adapting to test data variations, such…

机器学习 · 计算机科学 2024-03-29 Hyejin Park , Jeongyeon Hwang , Sunung Mun , Sangdon Park , Jungseul Ok

Test-Time Adaptation (TTA) has recently emerged as a promising strategy for tackling the problem of machine learning model robustness under distribution shifts by adapting the model during inference without access to any labels. Because of…

机器学习 · 计算机科学 2024-07-22 Sebastian Cygert , Damian Sójka , Tomasz Trzciński , Bartłomiej Twardowski

Test-time adaptation (TTA) for large language models (LLMs) updates model parameters at inference time using signals available at deployment. This paper focuses on a common yet under-explored regime: unsupervised, sample-specific TTA, where…

计算与语言 · 计算机科学 2026-02-11 Longhuan Xu , Cunjian Chen , Feng Yin

In this paper, online linear regression in environments corrupted by non-Gaussian noise (especially heavy-tailed noise) is addressed. In such environments, the error between the system output and the label also does not follow a Gaussian…

信息论 · 计算机科学 2021-05-13 Sajjad Bahrami , Ertem Tuncel

Test-time adaptation (TTA) aims to adapt a trained classifier using online unlabeled test data only, without any information related to the training procedure. Most existing TTA methods adapt the trained classifier using the classifier's…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Minguk Jang , Sae-Young Chung , Hye Won Chung

Time series forecasting faces two important but often overlooked challenges. Firstly, the inherent random noise in the time series labels sets a theoretical lower bound for the forecasting error, which is positively correlated with the…

机器学习 · 计算机科学 2025-09-26 Tianyi Shi , Zhu Meng , Yue Chen , Siyang Zheng , Fei Su , Jin Huang , Changrui Ren , Zhicheng Zhao

Test-time adaptation (TTA) methods have gained significant attention for enhancing the performance of vision-language models (VLMs) such as CLIP during inference, without requiring additional labeled data. However, current TTA researches…

机器学习 · 计算机科学 2025-10-14 Lijun Sheng , Jian Liang , Ran He , Zilei Wang , Tieniu Tan

Entropy minimization (EM) is frequently used to increase the accuracy of classification models when they're faced with new data at test time. EM is a self-supervised learning method that optimizes classifiers to assign even higher…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Ori Press , Ravid Shwartz-Ziv , Yann LeCun , Matthias Bethge

Test-time adaptation (TTA) is a technique aimed at enhancing the generalization performance of models by leveraging unlabeled samples solely during prediction. Given the need for robustness in neural network systems when faced with…

机器学习 · 计算机科学 2023-07-07 Yongcan Yu , Lijun Sheng , Ran He , Jian Liang

Current test-time adaptation (TTA) approaches aim to adapt a machine learning model to environments that change continuously. Yet, it is unclear whether TTA methods can maintain their adaptability over prolonged periods. To answer this…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Trung-Hieu Hoang , Duc Minh Vo , Minh N. Do

Text generation models are notoriously vulnerable to errors in the training data. With the wide-spread availability of massive amounts of web-crawled data becoming more commonplace, how can we enhance the robustness of models trained on a…

计算与语言 · 计算机科学 2024-03-20 Tianjian Li , Haoran Xu , Philipp Koehn , Daniel Khashabi , Kenton Murray

Robust loss minimization is an important strategy for handling robust learning issue on noisy labels. Current robust loss functions, however, inevitably involve hyperparameter(s) to be tuned, manually or heuristically through cross…

机器学习 · 计算机科学 2020-02-18 Jun Shu , Qian Zhao , Keyu Chen , Zongben Xu , Deyu Meng

Supervised fine-tuning of large language models relies on human-annotated data, yet annotation pipelines routinely involve multiple crowdworkers of heterogeneous expertise. Standard practice aggregates labels via majority vote or simple…

机器学习 · 计算机科学 2026-04-21 Sajjad Ghiasvand , Mark Beliaev , Mahnoosh Alizadeh , Ramtin Pedarsani

Test-time adaptation (TTA) addresses the unforeseen distribution shifts occurring during test time. In TTA, performance, memory consumption, and time consumption are crucial considerations. A recent diffusion-based TTA approach for…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Yeongtak Oh , Jonghyun Lee , Jooyoung Choi , Dahuin Jung , Uiwon Hwang , Sungroh Yoon

Multi-modal test-time adaptation (MM-TTA) adapts models to an unlabeled target domain by leveraging the complementary multi-modal inputs in an online manner. While previous MM-TTA methods for 3D segmentation offer a promising solution by…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Haozhi Cao , Yuecong Xu , Pengyu Yin , Xingyu Ji , Shenghai Yuan , Jianfei Yang , Lihua Xie

Encountering shifted data at test time is a ubiquitous challenge when deploying predictive models. Test-time adaptation (TTA) methods address this issue by continuously adapting a deployed model using only unlabeled test data. While TTA can…

机器学习 · 计算机科学 2025-11-11 Mona Schirmer , Metod Jazbec , Christian A. Naesseth , Eric Nalisnick

Test-Time Adaptation (TTA) enhances model robustness to out-of-distribution (OOD) data by updating the model online during inference, yet existing methods lack theoretical insights into the fundamental causes of performance degradation…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Xiao Chen , Zhongjing Du , Jiazhen Huang , Xu Jiang , Li Lu , Jingyan Jiang , Zhi Wang

Mainstream Test-Time Adaptation (TTA) methods for adapting vision-language models, e.g., CLIP, typically rely on Shannon Entropy (SE) at test time to measure prediction uncertainty and inconsistency. However, since CLIP has a built-in bias…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Xiangyu Wu , Dongming Jiang , Feng Yu , Yueying Tian , Jiaqi Tang , Qing-Guo Chen , Yang Yang , Jianfeng Lu