English
Related papers

Related papers: Temporal Test-Time Adaptation with State-Space Mod…

200 papers

Distribution shifts are common in real-world datasets and can affect the performance and reliability of deep learning models. In this paper, we study two types of distribution shifts: diversity shifts, which occur when test samples exhibit…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Alceu Bissoto , Catarina Barata , Eduardo Valle , Sandra Avila

Space-time adaptive processing (STAP) is one of the most effective approaches to suppressing ground clutters in airborne radar systems. It basically takes two forms, i.e., full-dimension STAP (FD-STAP) and reduced-dimension STAP (RD-STAP).…

Information Theory · Computer Science 2022-02-11 Di Song , Shengyao Chen , Feng Xi , Zhong Liu

Classical discriminant analysis assumes identically distributed training data, yet in many applications observations are collected over time and the class-conditional distributions drift. This population drift renders stationary classifiers…

Machine Learning · Computer Science 2025-08-25 Shuilian Xie , Mahdi Imani , Edward R. Dougherty , Ulisses M. Braga-Neto

Persistent monitoring of a spatiotemporal fluid process requires data sampling and predictive modeling of the process being monitored. In this paper we present PASST algorithm: Predictive-model based Adaptive Sampling of a Spatio-Temporal…

Robotics · Computer Science 2023-04-04 Sandeep Manjanna , Tom Z. Jiahao , M. Ani Hsieh

Test-time adaptation (TTA) aims to correct performance degradation of deep models under distribution shifts by updating models or inputs using unlabeled test data. Input-only diffusion-based TTA methods improve robustness for classification…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Jihyun Yu , Yoojin Oh , Wonho Bae , Mingyu Kim , Junhyug Noh

Test-time adaptation (TTA) of 3D point clouds is crucial for mitigating discrepancies between training and testing samples in real-world scenarios, particularly when handling corrupted point clouds. LiDAR data, for instance, can be affected…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Hamidreza Dastmalchi , Aijun An , Ali Cheraghian , Shafin Rahman , Sameera Ramasinghe

Recently, test-time adaptation (TTA) has been proposed as a promising solution for addressing distribution shifts. It allows a base model to adapt to an unforeseen distribution during inference by leveraging the information from the batch…

Machine Learning · Computer Science 2023-02-07 Tong Wu , Feiran Jia , Xiangyu Qi , Jiachen T. Wang , Vikash Sehwag , Saeed Mahloujifar , Prateek Mittal

Distributed sensor networks often include a multitude of sensors, each measuring parts of a process state space or observing the operations of a system. Communication of measurements between the sensor nodes and estimator(s) cannot…

Systems and Control · Electrical Eng. & Systems 2023-05-02 Sanjay Chandrasekaran , Vishnu Varadan , Siva Vignesh Krishnan , Florian Dörfler , Mohammad H. Mamduhi

Domain generalization aim to train models to effectively perform on samples that are unseen and outside of the distribution. Adversarial data augmentation (ADA) is a widely used technique in domain generalization. It enhances the model…

Machine Learning · Computer Science 2024-10-16 Byeong Tak Lee , Joon-myoung Kwon , Yong-Yeon Jo

We propose a method for adapting neural networks to distribution shifts at test-time. In contrast to training-time robustness mechanisms that attempt to anticipate and counter the shift, we create a closed-loop system and make use of a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Teresa Yeo , Oğuzhan Fatih Kar , Zahra Sodagar , Amir Zamir

Real-world image recognition systems often face corrupted input images, which cause distribution shifts and degrade the performance of models. These systems often use a single prediction model in a central server and process images sent…

Machine Learning · Computer Science 2025-12-03 Kazuki Adachi , Shin'ya Yamaguchi , Atsutoshi Kumagai

This paper introduces a linear state-space model with time-varying dynamics. The time dependency is obtained by forming the state dynamics matrix as a time-varying linear combination of a set of matrices. The time dependency of the weights…

Machine Learning · Statistics 2014-10-06 Jaakko Luttinen , Tapani Raiko , Alexander Ilin

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

To maintain the accuracy of supervised learning models in the presence of evolving data streams, we provide temporally-biased sampling schemes that weight recent data most heavily, with inclusion probabilities for a given data item decaying…

Databases · Computer Science 2019-06-14 Brian Hentschel , Peter J. Haas , Yuanyuan Tian

Image diffusion models are trained on independently sampled static images. While this is the bedrock task protocol in generative modeling, capturing the temporal world through the lens of static snapshots is information-deficient by design.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Juhun Lee , Simon S. Woo

Causal language models have demonstrated remarkable capabilities, but their size poses significant challenges for deployment in resource-constrained environments. Knowledge distillation, a widely-used technique for transferring knowledge…

Machine Learning · Computer Science 2025-03-03 Makoto Shing , Kou Misaki , Han Bao , Sho Yokoi , Takuya Akiba

Test-time adaptation (TTA) aims to adapt a model, initially trained on training data, to test data with potential distribution shifts. Most existing TTA methods focus on classification problems. The pronounced success of classification…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Chang'an Yi , Haotian Chen , Yifan Zhang , Yonghui Xu , Yan Zhou , Lizhen Cui

While most ML models expect independent and identically distributed data, this assumption is often violated in real-world scenarios due to distribution shifts, resulting in the degradation of machine learning model performance. Until now,…

Machine Learning · Computer Science 2024-11-19 Kai Helli , David Schnurr , Noah Hollmann , Samuel Müller , Frank Hutter

A critical and challenging problem in reinforcement learning is how to learn the state-action value function from the experience replay buffer and simultaneously keep sample efficiency and faster convergence to a high quality solution. In…

Machine Learning · Computer Science 2018-04-25 Weichao Li , Fuxian Huang , Xi Li , Gang Pan , Fei Wu

Real-world time-series datasets often violate the assumptions of standard supervised learning for forecasting -- their distributions evolve over time, rendering the conventional training and model selection procedures suboptimal. In this…

Machine Learning · Computer Science 2022-09-27 Sercan O. Arik , Nathanael C. Yoder , Tomas Pfister