English
Related papers

Related papers: Towards Reliable Test-Time Adaptation: Style Invar…

200 papers

Test-time adaptation (TTA) has shown to be effective at tackling distribution shifts between training and testing data by adapting a given model on test samples. However, the online model updating of TTA may be unstable and this is often a…

Machine Learning · Computer Science 2023-02-27 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Zhiquan Wen , Yaofo Chen , Peilin Zhao , Mingkui Tan

Test-time adaptation (TTA) is a technique aimed at enhancing the generalization performance of models by leveraging unlabeled samples solely during prediction. Given the need for robustness in neural network systems when faced with…

Machine Learning · Computer Science 2023-07-07 Yongcan Yu , Lijun Sheng , Ran He , Jian Liang

Deep learning models perform poorly when domain shifts exist between training and test data. Test-time adaptation (TTA) is a paradigm to mitigate this issue by adapting pre-trained models using only unlabeled test samples. However, existing…

Machine Learning · Computer Science 2025-05-27 Taeckyung Lee , Sorn Chottananurak , Junsu Kim , Jinwoo Shin , Taesik Gong , Sung-Ju Lee

In-context learning (ICL) has emerged as a powerful paradigm for task adaptation in large language models (LLMs), where models infer underlying task structures from a few demonstrations. However, ICL remains susceptible to biases that arise…

Computation and Language · Computer Science 2025-06-18 Zhihang Tan , Jingrui Hou , Ping Wang , Qibiao Hu , Peng Zhu

Transformers have become a standard architecture in machine learning, demonstrating strong in-context learning (ICL) abilities that allow them to learn from the prompt at inference time. However, uncertainty quantification for ICL remains…

Machine Learning · Statistics 2025-04-23 Zhe Huang , Simone Rossi , Rui Yuan , Thomas Hannagan

Visual in-context learning (VICL), as a new paradigm in computer vision, allows the model to rapidly adapt to various tasks with only a handful of prompts and examples. While effective, the existing VICL paradigm exhibits poor…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Jiahao Xie , Alessio Tonioni , Nathalie Rauschmayr , Federico Tombari , Bernt Schiele

Test-time adaptation (TTA) addresses distribution shifts for streaming test data in unsupervised settings. Currently, most TTA methods can only deal with minor shifts and rely heavily on heuristic and empirical studies. To advance TTA under…

Machine Learning · Computer Science 2024-04-09 Shurui Gui , Xiner Li , Shuiwang Ji

Just like the previous generation of task-tuned models, large language models (LLMs) that are adapted to tasks via prompt-based methods like in-context-learning (ICL) perform well in some setups but not in others. This lack of consistency…

Computation and Language · Computer Science 2023-12-11 Lucas Weber , Elia Bruni , Dieuwke Hupkes

Test-time adaptation (TTA) has emerged as a viable solution to adapt pre-trained models to domain shifts using unlabeled test data. However, TTA faces challenges of adaptation failures due to its reliance on blind adaptation to unknown test…

Machine Learning · Computer Science 2024-04-03 Taeckyung Lee , Sorn Chottananurak , Taesik Gong , Sung-Ju Lee

This paper proposes a novel online evaluation protocol for Test Time Adaptation (TTA) methods, which penalizes slower methods by providing them with fewer samples for adaptation. TTA methods leverage unlabeled data at test time to adapt to…

Continual test-time domain adaptation (CTTA) aims to adjust pre-trained source models to perform well over time across non-stationary target environments. While previous methods have made considerable efforts to optimize the adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yanshuo Wang , Xuesong Li , Jinguang Tong , Jie Hong , Jun Lan , Weiqiang Wang , Huijia Zhu , Haoxing Chen

Vision-Language Models (VLMs) such as CLIP enable strong zero-shot recognition but suffer substantial degradation under distribution shifts. Test-Time Adaptation (TTA) aims to improve robustness using only unlabeled test samples, yet most…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Sanggeon Yun , Ryozo Masukawa , SungHeon Jeong , Wenjun Huang , Hanning Chen , Mohsen Imani

State-of-the-art (SOTA) semi-supervised learning (SSL) methods have been highly successful in leveraging a mix of labeled and unlabeled data by combining techniques of consistency regularization and pseudo-labeling. During pseudo-labeling,…

Signal Temporal Logic (STL) inference learns interpretable logical rules for temporal behaviors in dynamical systems. To ensure the correctness of learned STL formulas, recent approaches have incorporated conformal prediction as a…

Machine Learning · Computer Science 2026-03-31 Yixuan Wang , Danyang Li , Matthew Cleaveland , Roberto Tron , Mingyu Cai

Existing test-time adaptation (TTA) approaches often adapt models with the unlabeled testing data stream. A recent attempt relaxed the assumption by introducing limited human annotation, referred to as Human-In-the-Loop Test-Time Adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Yushu Li , Yongyi Su , Xulei Yang , Kui Jia , Xun Xu

Test-time adaptation (TTA) has recently emerged as a promising approach for improving time series forecasting (TSF) under distribution shift. Existing TSF-TTA methods differ in how they utilize revealed targets, yet the resulting adaptation…

Machine Learning · Computer Science 2026-05-19 Haochun Wang , Ruichen Xu , Georgios Kementzidis , Karen Cho , Sebastian Ramirez Villarreal , Yuefan Deng

While test-time scaling has enabled large language models to solve highly difficult tasks, state-of-the-art results come at exorbitant compute costs. These inefficiencies can be attributed to the miscalibration of post-trained language…

Machine Learning · Computer Science 2026-04-02 Cai Zhou , Zekai Wang , Menghua Wu , Qianyu Julie Zhu , Flora C. Shi , Chenyu Wang , Ashia Wilson , Tommi Jaakkola , Stephen Bates

Test time adaptation (TTA) equips deep learning models to handle unseen test data that deviates from the training distribution, even when source data is inaccessible. While traditional TTA methods often rely on entropy as a confidence…

Machine Learning · Computer Science 2024-09-17 Afshar Shamsi , Rejisa Becirovic , Ahmadreza Argha , Ehsan Abbasnejad , Hamid Alinejad-Rokny , Arash Mohammadi

Signal Temporal Logic (STL) inference seeks to extract human-interpretable rules from time-series data, but existing methods lack formal confidence guarantees for the inferred rules. Conformal prediction (CP) is a technique that can provide…

Machine Learning · Computer Science 2025-10-23 Danyang Li , Yixuan Wang , Matthew Cleaveland , Mingyu Cai , Roberto Tron

The goal of the challenge is to develop a test-time adaptation (TTA) method, which could adapt the model to gradually changing domains in video sequences for semantic segmentation task. It is based on a synthetic driving video dataset -…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Damian Sójka , Yuyang Liu , Dipam Goswami , Sebastian Cygert , Bartłomiej Twardowski , Joost van de Weijer