English
Related papers

Related papers: Revisiting Realistic Test-Time Training: Sequentia…

200 papers

This paper introduces a novel application of Test-Time Training (TTT) for Speech Enhancement, addressing the challenges posed by unpredictable noise conditions and domain shifts. This method combines a main speech enhancement task with a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-21 Avishkar Behera , Riya Ann Easow , Venkatesh Parvathala , K. Sri Rama Murty

Test-time training (TTT) enhances model performance by explicitly updating designated parameters prior to each prediction to adapt to the test data. While TTT has demonstrated considerable empirical success, its theoretical underpinnings…

Machine Learning · Statistics 2026-02-03 Kento Kuwataka , Taiji Suzuki

Despite their exceptional performance in vision tasks, deep learning models often struggle when faced with domain shifts during testing. Test-Time Training (TTT) methods have recently gained popularity by their ability to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 David Osowiechi , Gustavo A. Vargas Hakim , Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers

Sequential recommendation tasks, which aim to predict the next item a user will interact with, typically rely on models trained solely on historical data. However, in real-world scenarios, user behavior can fluctuate in the long interaction…

Information Retrieval · Computer Science 2024-10-01 Zhaoqi Yang , Yanan Wang , Yong Ge

Domain adaptation helps generalizing object detection models to target domain data with distribution shift. It is often achieved by adapting with access to the whole target domain data. In a more realistic scenario, target distribution is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Yijin Chen , Xun Xu , Yongyi Su , Kui Jia

Deep neural networks often degrade under distribution shifts. Although domain adaptation offers a solution, privacy constraints often prevent access to source data, making Test-Time Adaptation (TTA, which adapts using only unlabeled test…

Machine Learning · Computer Science 2025-06-10 Linjing You , Jiabao Lu , Xiayuan Huang

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model…

Machine Learning · Computer Science 2023-01-12 Taesik Gong , Jongheon Jeong , Taewon Kim , Yewon Kim , Jinwoo Shin , Sung-Ju Lee

Machine learning methods strive to acquire a robust model during the training process that can effectively generalize to test samples, even in the presence of distribution shifts. However, these methods often suffer from performance…

Machine Learning · Computer Science 2024-12-13 Jian Liang , Ran He , Tieniu Tan

Test-time adaptation (TTA) is a technique used to reduce distribution gaps between the training and testing sets by leveraging unlabeled test data during inference. In this work, we expand TTA to a more practical scenario, where the test…

Machine Learning · Computer Science 2023-03-06 Chenyan Wu , Yimu Pan , Yandong Li , James Z. Wang

Domain shift is a common problem in the realistic world, where training data and test data follow different data distributions. To deal with this problem, fully test-time adaptation (TTA) leverages the unlabeled data encountered during test…

Artificial Intelligence · Computer Science 2024-04-29 Guoliang Lin , Hanjiang Lai , Yan Pan , Jian Yin

Test-Time Compute (TTC) has emerged as a powerful paradigm for enhancing the performance of Large Language Models (LLMs) at inference, leveraging strategies such as Test-Time Training (TTT) and Retrieval-Augmented Generation (RAG). However,…

Computation and Language · Computer Science 2025-08-15 J. Pablo Muñoz , Jinjie Yuan

We study the problem of continual test-time adaption where the goal is to adapt a source pre-trained model to a sequence of unlabelled target domains at test time. Existing methods on test-time training suffer from several limitations: (1)…

Machine Learning · Computer Science 2024-10-03 Kien X. Nguyen , Fengchun Qiao , Xi Peng

Test-time adaptation (TTA) addresses distribution shifts for streaming test data in unsupervised settings. Currently, most TTA methods can only deal with minor shifts and rely heavily on heuristic and empirical studies. To advance TTA under…

Machine Learning · Computer Science 2024-04-09 Shurui Gui , Xiner Li , Shuiwang Ji

The remarkable progress in deep learning (DL) showcases outstanding results in various computer vision tasks. However, adaptation to real-time variations in data distributions remains an important challenge. Test-Time Training (TTT) was…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Marco Colussi , Sergio Mascetti , Jose Dolz , Christian Desrosiers

Test-time domain adaptation is a challenging task that aims to adapt a pre-trained model to limited, unlabeled target data during inference. Current methods that rely on self-supervision and entropy minimization underperform when the…

Machine Learning · Computer Science 2024-10-03 Chen Tao , Li Shen , Soumik Mondal

Unsupervised tabular anomaly detection methods typically learn feature patterns from normal samples during training and subsequently identify samples that deviate from these patterns as anomalies during testing. However, in practical…

Machine Learning · Computer Science 2026-05-12 Wei Huang , Hezhe Qiao , Kailai Zhang , Zaisheng Ye , Yu-Ming Shang , Xiangling Fu

Language models (LMs) have shown impressive performance on tasks within their training distribution, but often struggle with structurally novel tasks even when given a small number of in-context task examples. We investigate the…

Artificial Intelligence · Computer Science 2025-03-26 Ekin Akyürek , Mehul Damani , Adam Zweiger , Linlu Qiu , Han Guo , Jyothish Pari , Yoon Kim , Jacob Andreas

Domain adaptation refers to the problem of leveraging labeled data in a source domain to learn an accurate model in a target domain where labels are scarce or unavailable. A recent approach for finding a common representation of the two…

Machine Learning · Statistics 2018-03-20 Rui Shu , Hung H. Bui , Hirokazu Narui , Stefano Ermon

Test-time domain adaptation aims to adapt a source pre-trained model to a target domain without using any source data. Existing works mainly consider the case where the target domain is static. However, real-world machine perception systems…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Qin Wang , Olga Fink , Luc Van Gool , Dengxin Dai

Test-time adaptation (TTA) is a technique aimed at enhancing the generalization performance of models by leveraging unlabeled samples solely during prediction. Given the need for robustness in neural network systems when faced with…

Machine Learning · Computer Science 2023-07-07 Yongcan Yu , Lijun Sheng , Ran He , Jian Liang