English
Related papers

Related papers: SEVA: Leveraging Single-Step Ensemble of Vicinal A…

200 papers

In Test-time Adaptation (TTA), given a source model, the goal is to adapt it to make better predictions for test instances from a different distribution than the source. Crucially, TTA assumes no access to the source data or even any…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Ansh Khurana , Sujoy Paul , Piyush Rai , Soma Biswas , Gaurav Aggarwal

Vision-language models (VLMs) exhibit remarkable zero-shot generalization but suffer performance degradation under distribution shifts in downstream tasks, particularly in the absence of labeled data. Test-Time Adaptation (TTA) addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Khanh-Binh Nguyen , Phuoc-Nguyen Bui , Hyunseung Choo , Duc Thanh Nguyen

Averaging predictions over a set of models -- an ensemble -- is widely used to improve predictive performance and uncertainty estimation of deep learning models. At the same time, many machine learning systems, such as search, matching, and…

Machine Learning · Computer Science 2021-07-15 Arsenii Ashukha , Andrei Atanov , Dmitry Vetrov

Current test-time adaptation (TTA) approaches aim to adapt a machine learning model to environments that change continuously. Yet, it is unclear whether TTA methods can maintain their adaptability over prolonged periods. To answer this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Trung-Hieu Hoang , Duc Minh Vo , Minh N. Do

Data augmentation is widely used for machine learning; however, an effective method to apply data augmentation has not been established even though it includes several factors that should be tuned carefully. One such factor is sample…

Machine Learning · Computer Science 2020-10-30 Tomoumi Takase , Ryo Karakida , Hideki Asoh

The problem of adapting models from a source domain using data from any target domain of interest has gained prominence, thanks to the brittle generalization in deep neural networks. While several test-time adaptation techniques have…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Rakshith Subramanyam , Kowshik Thopalli , Spring Berman , Pavan Turaga , Jayaraman J. Thiagarajan

Recent advances in data augmentation enable one to translate images by learning the mapping between a source domain and a target domain. Existing methods tend to learn the distributions by training a model on a variety of datasets, with…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Boyi Li , Yin Cui , Tsung-Yi Lin , Serge Belongie

Test-time augmentation -- the aggregation of predictions across transformed examples of test inputs -- is an established technique to improve the performance of image classification models. Importantly, TTA can be used to improve model…

Machine Learning · Computer Science 2022-06-29 Helen Lu , Divya Shanmugam , Harini Suresh , John Guttag

Nowadays, deep neural networks outperform humans in many tasks. However, if the input distribution drifts away from the one used in training, their performance drops significantly. Recently published research has shown that adapting the…

Machine Learning · Computer Science 2022-05-19 Alexander Bartler , Florian Bender , Felix Wiewel , Bin Yang

Test-time adaptation (TTA) aims to improve model generalizability when test data diverges from training distribution, offering the distinct advantage of not requiring access to training data and processes, especially valuable in the context…

Machine Learning · Computer Science 2024-02-28 Yige Yuan , Bingbing Xu , Liang Hou , Fei Sun , Huawei Shen , Xueqi Cheng

Test-time adaptation (TTA) is a technique used to reduce distribution gaps between the training and testing sets by leveraging unlabeled test data during inference. In this work, we expand TTA to a more practical scenario, where the test…

Machine Learning · Computer Science 2023-03-06 Chenyan Wu , Yimu Pan , Yandong Li , James Z. Wang

With the rise of Deep Neural Networks, machine learning systems are nowadays ubiquitous in a number of real-world applications, which bears the need for highly reliable models. This requires a thorough look not only at the accuracy of such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Pedro Conde , Tiago Barros , Rui L. Lopes , Cristiano Premebida , Urbano J. Nunes

Test-time adaptation (TTA) has shown to be effective at tackling distribution shifts between training and testing data by adapting a given model on test samples. However, the online model updating of TTA may be unstable and this is often a…

Machine Learning · Computer Science 2023-02-27 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Zhiquan Wen , Yaofo Chen , Peilin Zhao , Mingkui Tan

Recently, test-time adaptation (TTA) has been proposed as a promising solution for addressing distribution shifts. It allows a base model to adapt to an unforeseen distribution during inference by leveraging the information from the batch…

Machine Learning · Computer Science 2023-02-07 Tong Wu , Feiran Jia , Xiangyu Qi , Jiachen T. Wang , Vikash Sehwag , Saeed Mahloujifar , Prateek Mittal

Integrating model-free and model-based approaches in reinforcement learning has the potential to achieve the high performance of model-free algorithms with low sample complexity. However, this is difficult because an imperfect dynamics…

Machine Learning · Computer Science 2019-06-10 Jacob Buckman , Danijar Hafner , George Tucker , Eugene Brevdo , Honglak Lee

Test-Time Adaptation (TTA) via entropy minimization (EM) has proven effective for classification tasks, yet its application to generative autoregressive models remains theoretically fragmented. Existing approaches typically rely on distinct…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-12 Wei-Ping Huang , Chee-En Yu , Guan-Ting Lin , Hung-yi Lee

Reliable long-term decoding of surface electromyography (EMG) is hindered by signal drift caused by electrode shifts, muscle fatigue, and posture changes. While state-of-the-art models achieve high intra-session accuracy, their performance…

Machine Learning · Computer Science 2026-01-08 Nia Touko , Matthew O A Ellis , Cristiano Capone , Alessio Burrello , Elisa Donati , Luca Manneschi

Deep learning models often struggle under natural distribution shifts, a common challenge in real-world deployments. Test-Time Adaptation (TTA) addresses this by adapting models during inference without labeled source data. We present the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 John Turnbull , Shivam Grover , Amin Jalali , Ali Etemad

Test-time augmentation (TTA)--aggregating predictions over multiple augmented copies of a test input--is widely assumed to improve classification accuracy, particularly in medical imaging where it is routinely deployed in production systems…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Daniel Nobrega Medeiros

Although deep learning-based end-to-end Automatic Speech Recognition (ASR) has shown remarkable performance in recent years, it suffers severe performance regression on test samples drawn from different data distributions. Test-time…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Guan-Ting Lin , Shang-Wen Li , Hung-yi Lee