English
Related papers

Related papers: Test-Time Augmentation Meets Variational Bayes

200 papers

Data-Augmentation (DA) is known to improve performance across tasks and datasets. We propose a method to theoretically analyze the effect of DA and study questions such as: how many augmented samples are needed to correctly estimate the…

Machine Learning · Computer Science 2022-02-18 Randall Balestriero , Ishan Misra , Yann LeCun

Since distribution shifts are likely to occur during test-time and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model after deployment, leveraging the current test data.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Robert A. Marsden , Mario Döbler , Bin Yang

Data augmentation forms the cornerstone of many modern machine learning training pipelines; yet, the mechanisms by which it works are not clearly understood. Much of the research on data augmentation (DA) has focused on improving existing…

Machine Learning · Computer Science 2023-04-13 Damien A. Dablain , Nitesh V. Chawla

With the rise of Deep Neural Networks, machine learning systems are nowadays ubiquitous in a number of real-world applications, which bears the need for highly reliable models. This requires a thorough look not only at the accuracy of such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Pedro Conde , Tiago Barros , Rui L. Lopes , Cristiano Premebida , Urbano J. Nunes

We propose Test-Time Augmentation (TTA) as an effective technique for addressing combinatorial optimization problems, including the Traveling Salesperson Problem. In general, deep learning models possessing the property of invariance, where…

Machine Learning · Computer Science 2024-05-09 Ryo Ishiyama , Takahiro Shirakawa , Seiichi Uchida , Shinnosuke Matsuo

Test-time adaptation (TTA) addresses distribution shifts for streaming test data in unsupervised settings. Currently, most TTA methods can only deal with minor shifts and rely heavily on heuristic and empirical studies. To advance TTA under…

Machine Learning · Computer Science 2024-04-09 Shurui Gui , Xiner Li , Shuiwang Ji

Data augmentation is a powerful technique to enhance the performance of a deep learning task but has received less attention in 3D deep learning. It is well known that when 3D shapes are sparsely represented with low point density, the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Tuan-Anh Vu , Srinjay Sarkar , Zhiyuan Zhang , Binh-Son Hua , Sai-Kit Yeung

Machine learning methods strive to acquire a robust model during the training process that can effectively generalize to test samples, even in the presence of distribution shifts. However, these methods often suffer from performance…

Machine Learning · Computer Science 2024-12-13 Jian Liang , Ran He , Tieniu Tan

Test-time adaptation (TTA) updates the model weights during the inference stage using testing data to enhance generalization. However, this practice exposes TTA to adversarial risks. Existing studies have shown that when TTA is updated with…

Machine Learning · Computer Science 2025-03-03 Yongyi Su , Yushu Li , Nanqing Liu , Kui Jia , Xulei Yang , Chuan-Sheng Foo , Xun Xu

Fully Test-Time Adaptation (TTA), which aims at adapting models to data drifts, has recently attracted wide interest. Numerous tricks and techniques have been proposed to ensure robust learning on arbitrary streams of unlabeled data.…

Machine Learning · Computer Science 2023-11-13 Saypraseuth Mounsaveng , Florent Chiaroni , Malik Boudiaf , Marco Pedersoli , Ismail Ben Ayed

We consider the problem of improving the human instance segmentation mask quality for a given test image using keypoints estimation. We compare two alternative approaches. The first approach is a test-time adaptation (TTA) method, where we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Kambiz Azarian , Debasmit Das , Hyojin Park , Fatih Porikli

Factual probing is a method that uses prompts to test if a language model "knows" certain world knowledge facts. A problem in factual probing is that small changes to the prompt can lead to large changes in model output. Previous work aimed…

Computation and Language · Computer Science 2023-10-27 Go Kamoda , Benjamin Heinzerling , Keisuke Sakaguchi , Kentaro Inui

Active Test-Time Adaptation (ATTA) improves model robustness under domain shift by selectively querying human annotations at deployment, but existing methods use heuristic uncertainty measures and suffer from low data selection efficiency,…

Machine Learning · Computer Science 2025-10-01 Tingyu Shi , Fan Lyu , Shaoliang Peng

Test-Time adaptation (TTA) aims to enhance model robustness against distribution shifts through rapid model adaptation during inference. While existing TTA methods often rely on entropy-based unsupervised training and achieve promising…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Zixuan Hu , Yichun Hu , Ling-Yu Duan

Machine learning models for text classification often excel on in-distribution (ID) data but struggle with unseen out-of-distribution (OOD) inputs. Most techniques for improving OOD robustness are not applicable to settings where the model…

Machine Learning · Computer Science 2024-08-06 Kyle O'Brien , Nathan Ng , Isha Puri , Jorge Mendez , Hamid Palangi , Yoon Kim , Marzyeh Ghassemi , Thomas Hartvigsen

Test-time augmentation -- the aggregation of predictions across transformed versions of a test input -- is a common practice in image classification. Traditionally, predictions are combined using a simple average. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Divya Shanmugam , Davis Blalock , Guha Balakrishnan , John Guttag

Test-time adaptation (TTA) enhances the zero-shot robustness under distribution shifts by leveraging unlabeled test data during inference. Despite notable advances, several challenges still limit its broader applicability. First, most…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Youjia Zhang , Youngeun Kim , Young-Geun Choi , Hongyeob Kim , Huiling Liu , Sungeun Hong

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

Machine Learning · Computer Science 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu

Textual data augmentation (DA) is a prolific field of study where novel techniques to create artificial data are regularly proposed, and that has demonstrated great efficiency on small data settings, at least for text classification tasks.…

Computation and Language · Computer Science 2024-09-18 Frédéric Piedboeuf , Philippe Langlais

Deep models often suffer significant performance degradation under distribution shifts. Domain generalization (DG) seeks to mitigate this challenge by enabling models to generalize to unseen domains. Most prior approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Zhicheng Lin , Xiaolin Wu , Xi Zhang