English
Related papers

Related papers: Adaptive Debiasing Tsallis Entropy for Test-Time A…

200 papers

We propose a method for test-time adaptation of pretrained depth completion models. Depth completion models, trained on some ``source'' data, often predict erroneous outputs when transferred to ``target'' data captured in novel…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Younjoon Chung , Hyoungseob Park , Patrick Rim , Xiaoran Zhang , Jihe He , Ziyao Zeng , Safa Cicek , Byung-Woo Hong , James S. Duncan , Alex Wong

The generalization capability of unsupervised domain adaptation can mitigate the need for extensive pixel-level annotations to train semantic segmentation networks by training models on synthetic data as a source with computer-generated…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Hye-Seong Hong , Abhishek Kumar , Dong-Gyu Lee

For safety-related applications, it is crucial to produce trustworthy deep neural networks whose prediction is associated with confidence that can represent the likelihood of correctness for subsequent decision-making. Existing dense binary…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Jiawei Liu , Changkun Ye , Shan Wang , Ruikai Cui , Jing Zhang , Kaihao Zhang , Nick Barnes

One fascinating aspect of pre-trained vision-language models~(VLMs) learning under language supervision is their impressive zero-shot generalization capability. However, this ability is hindered by distribution shifts between the training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Shuai Zhao , Xiaohan Wang , Linchao Zhu , Yi Yang

Deep Neural Networks (DNNs) have achieved remarkable success in a variety of tasks, especially when it comes to prediction accuracy. However, in complex real-world scenarios, particularly in safety-critical applications, high accuracy alone…

Artificial Intelligence · Computer Science 2024-05-31 Han Liu , Peng Cui , Bingning Wang , Jun Zhu , Xiaolin Hu

Video anomaly detection (VAD) -- commonly formulated as a multiple-instance learning problem in a weakly-supervised manner due to its labor-intensive nature -- is a challenging problem in video surveillance where the frames of anomaly need…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Hyekang Kevin Joo , Khoa Vo , Kashu Yamazaki , Ngan Le

A model must adapt itself to generalize to new and different data during testing. In this setting of fully test-time adaptation the model has only the test data and its own parameters. We propose to adapt by test entropy minimization…

Machine Learning · Computer Science 2021-03-19 Dequan Wang , Evan Shelhamer , Shaoteng Liu , Bruno Olshausen , Trevor Darrell

Real-world time series often exhibit a non-stationary nature, degrading the performance of pre-trained forecasting models. Test-Time Adaptation (TTA) addresses this by adjusting models during inference, but existing methods typically update…

Machine Learning · Computer Science 2025-07-01 Heitor R. Medeiros , Hossein Sharifi-Noghabi , Gabriel L. Oliveira , Saghar Irandoust

Large language models (LLMs) have demonstrated remarkable capabilities in generating programs from natural language descriptions, yet ensuring their correctness without an external oracle remains a critical challenge. To solve the…

Software Engineering · Computer Science 2026-04-07 Yunxiang Wei , Tianlin Li , Yuwei Zheng , Yanni Dong , Aishan Liu , Qiang Hu , Xiaoyu Zhang , Mingfei Cheng , Jian Yang

Semi-supervised learning (SSL) has achieved significant progress by leveraging both labeled data and unlabeled data. Existing SSL methods overlook a common real-world scenario when labeled data is extremely scarce, potentially as limited as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Hezhao Liu , Yang Lu , Mengke Li , Yiqun Zhang , Shreyank N Gowda , Chen Gong , Hanzi Wang

Currently, pre-trained language models (PLMs) do not cope well with the distribution shift problem, resulting in models trained on the training set failing in real test scenarios. To address this problem, the test-time adaptation (TTA)…

Computation and Language · Computer Science 2023-04-26 Yi Su , Yixin Ji , Juntao Li , Hai Ye , Min Zhang

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

Anomaly detection is a well-known task that involves the identification of abnormal events that occur relatively infrequently. Methods for improving anomaly detection performance have been widely studied. However, no studies utilizing…

Machine Learning · Computer Science 2025-02-10 Seffi Cohen , Niv Goldshlager , Lior Rokach , Bracha Shapira

Test Time Adaptation (TTA) addresses the problem of distribution shift by adapting a pretrained model to a new domain during inference. When faced with challenging shifts, most methods collapse and perform worse than the original pretrained…

Machine Learning · Computer Science 2025-02-25 Sabyasachi Sahoo , Mostafa ElAraby , Jonas Ngnawe , Yann Pequignot , Frederic Precioso , Christian Gagne

Estimating entropies from limited data series is known to be a non-trivial task. Naive estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new 'balanced estimator' for entropy functionals Shannon,…

Statistical Mechanics · Physics 2008-04-30 Juan A. Bonachela , Haye Hinrichsen , Miguel A. Munoz

Despite recent advancements in Self-Supervised Learning (SSL) for time series analysis, a noticeable gap persists between the anticipated achievements and actual performance. While these methods have demonstrated formidable generalization…

Machine Learning · Computer Science 2024-07-25 Adrian Atienza , Jakob Bardram , Sadasivan Puthusserypady

Vision-language models (VLMs) such as CLIP exhibit strong zero-shot generalization but remain sensitive to domain shifts at test time. Test-time prompt tuning (TPT) mitigates this issue by adapting prompts with fixed augmentations, which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Yuqing Lei , Yingjun Du , Yawen Huang , Xiantong Zhen , Ling Shao

Real-world reinforcement learning often faces environment drift, but most existing methods rely on static entropy coefficients/target entropy, causing over-exploration during stable periods and under-exploration after drift, and leaving…

Machine Learning · Computer Science 2026-05-19 Tongxi Wang , Zhuoyang Xia , Xinran Chen , Shan Liu

Recently, test-time adaptation has garnered attention as a method for tuning models without labeled data. The conventional modus operandi for adapting pre-trained vision-language models (VLMs) during test-time primarily focuses on tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Raza Imam , Asif Hanif , Jian Zhang , Khaled Waleed Dawoud , Yova Kementchedjhieva , Mohammad Yaqub

Pre-trained vision-language models (e.g., CLIP) have shown promising zero-shot generalization in many downstream tasks with properly designed text prompts. Instead of relying on hand-engineered prompts, recent works learn prompts using the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Manli Shu , Weili Nie , De-An Huang , Zhiding Yu , Tom Goldstein , Anima Anandkumar , Chaowei Xiao