English
Related papers

Related papers: Temporal Test-Time Adaptation with State-Space Mod…

200 papers

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

Vision-language models (VLMs) such as CLIP achieve strong zero-shot recognition but degrade significantly under \textit{temporally evolving distribution shifts} common in real-world scenarios (e.g., gradual illumination or seasonal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Shuang Cui , Jinglin Xu , Yi Li , Xiongxin Tang , Jiangmeng Li , Jiahuan Zhou , Fanjiang Xu , Fuchun Sun , Hui Xiong

To maintain the accuracy of supervised learning models in the presence of evolving data streams, we provide temporally-biased sampling schemes that weight recent data most heavily, with inclusion probabilities for a given data item decaying…

Databases · Computer Science 2018-01-31 Brian Hentschel , Peter J. Haas , Yuanyuan Tian

Test-time training adapts to a new test distribution on the fly by optimizing a model for each test input using self-supervision. In this paper, we use masked autoencoders for this one-sample learning problem. Empirically, our simple method…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Yossi Gandelsman , Yu Sun , Xinlei Chen , Alexei A. Efros

Most unsupervised anomaly detection methods based on representations of normal samples to distinguish anomalies have recently made remarkable progress. However, existing methods only learn a single decision boundary for distinguishing the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Tianwu Lei , Silin Chen , Bohan Wang , Zhengkai Jiang , Ningmu Zou

On-device adapting to continual, unpredictable domain shifts is essential for mobile applications like autonomous driving and augmented reality to deliver seamless user experiences in evolving environments. Test-time adaptation (TTA)…

Machine Learning · Computer Science 2024-10-14 Cheng Fang , Sicong Liu , Zimu Zhou , Bin Guo , Jiaqi Tang , Ke Ma , Zhiwen Yu

Test-Time Adaptation (TTA) adapts pre-trained models using only unlabeled test streams, requiring real-time inference and update without access to source data. We propose StructuralTest-time Alignment of Gradients (STAG), a lightweight…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Juhyeon Shin , Yujin Oh , Jonghyun Lee , Saehyung Lee , Minjun Park , Dongjun Lee , Uiwon Hwang , Sungroh Yoon

Diffusion models have been used for probabilistic time series forecasting and show strong potential. However, fixed noise schedules often produce intermediate states that are hard to invert and a terminal state that deviates from the near…

Machine Learning · Computer Science 2026-03-03 Jintao Zhang , Zirui Liu , Mingyue Cheng , Xianquan Wang , Zhiding Liu , Qi Liu

Test-time adaptation with pre-trained vision-language models has attracted increasing attention for tackling distribution shifts during the test time. Though prior studies have achieved very promising performance, they involve intensive…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Adilbek Karmanov , Dayan Guan , Shijian Lu , Abdulmotaleb El Saddik , Eric Xing

Since autonomous driving systems usually face dynamic and ever-changing environments, continual test-time adaptation (CTTA) has been proposed as a strategy for transferring deployed models to continually changing target domains. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Jiayi Ni , Senqiao Yang , Ran Xu , Jiaming Liu , Xiaoqi Li , Wenyu Jiao , Zehui Chen , Yi Liu , Shanghang Zhang

Continual Test-Time Adaptation (CTA) is a challenging task that aims to adapt a source pre-trained model to continually changing target domains. In the CTA setting, a model does not know when the target domain changes, thus facing a drastic…

Machine Learning · Computer Science 2024-03-05 Inseop Chung , Kyomin Hwang , Jayeon Yoo , Nojun Kwak

Subjective time-series regression (STR) tasks have gained increasing attention recently. However, most existing methods overlook the label distribution bias in STR data, which results in biased models. Emerging studies on imbalanced…

Machine Learning · Computer Science 2023-07-18 Wenxin Xu , Hexin Jiang , Xuefeng Liang , Ying Zhou , Yin Zhao , Jie Zhang

Test-time adaptation (TTA) addresses the unforeseen distribution shifts occurring during test time. In TTA, performance, memory consumption, and time consumption are crucial considerations. A recent diffusion-based TTA approach for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yeongtak Oh , Jonghyun Lee , Jooyoung Choi , Dahuin Jung , Uiwon Hwang , Sungroh Yoon

Real-world deployment of computer vision systems, including in the discovery processes of biomedical research, requires causal representations that are invariant to contextual nuisances and generalize to new data. Leveraging the internal…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Wolfgang M. Pernice , Michael Doron , Alex Quach , Aditya Pratapa , Sultan Kenjeyev , Nicholas De Veaux , Michio Hirano , Juan C. Caicedo

Deep learning based image reconstruction methods outperform traditional methods. However, neural networks suffer from a performance drop when applied to images from a different distribution than the training images. For example, a model…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Mohammad Zalbagi Darestani , Jiayu Liu , Reinhard Heckel

Model-based optimization (MBO) is increasingly applied to design problems in science and engineering. A common scenario involves using a fixed training set to train models, with the goal of designing new samples that outperform those…

Machine Learning · Computer Science 2023-11-10 Farhan Damani , David H Brookes , Theodore Sternlieb , Cameron Webster , Stephen Malina , Rishi Jajoo , Kathy Lin , Sam Sinai

Given the inevitability of domain shifts during inference in real-world applications, test-time adaptation (TTA) is essential for model adaptation after deployment. However, the real-world scenario of continuously changing target…

Machine Learning · Computer Science 2023-11-28 Junyoung Park , Jin Kim , Hyeongjun Kwon , Ilhoon Yoon , Kwanghoon Sohn

Machine learning models frequently experience performance drops under distribution shifts. The underlying cause of such shifts may be multiple simultaneous factors such as changes in data quality, differences in specific covariate…

Machine Learning · Computer Science 2023-06-07 Haoran Zhang , Harvineet Singh , Marzyeh Ghassemi , Shalmali Joshi

The basic underlying assumption of machine learning (ML) models is that the training and test data are sampled from the same distribution. However, in daily practice, this assumption is often broken, i.e. the distribution of the test data…

Computation and Language · Computer Science 2026-01-16 Adriana Valentina Costache , Silviu Florin Gheorghe , Eduard Gabriel Poesina , Paul Irofti , Radu Tudor Ionescu

Language models often struggle with temporal misalignment, performance degradation caused by shifts in the temporal distribution of data. Continuously updating models to avoid degradation is expensive. Can models be adapted without updating…

Machine Learning · Computer Science 2025-03-26 Changho Shin , Xinya Yan , Suenggwan Jo , Sungjun Cho , Shourjo Aditya Chaudhuri , Frederic Sala