English
Related papers

Related papers: Test-Time Adaptation with Perturbation Consistency…

200 papers

Machine learning models for text classification often excel on in-distribution (ID) data but struggle with unseen out-of-distribution (OOD) inputs. Most techniques for improving OOD robustness are not applicable to settings where the model…

Machine Learning · Computer Science 2024-08-06 Kyle O'Brien , Nathan Ng , Isha Puri , Jorge Mendez , Hamid Palangi , Yoon Kim , Marzyeh Ghassemi , Thomas Hartvigsen

Test Time Adaptation (TTA) is a pivotal concept in machine learning, enabling models to perform well in real-world scenarios, where test data distribution differs from training. In this work, we propose a novel approach called pseudo Source…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Manogna Sreenivas , Goirik Chakrabarty , Soma Biswas

Supervised Causal Learning (SCL) has shown promise in causal discovery by framing it as a supervised learning problem. However, it suffers from significant out-of-distribution generalization challenges. We reveal three limitations of…

Machine Learning · Computer Science 2026-05-29 Zizhen Deng , Jiaru Zhang , Rui Ding , Huang Bojun , Jinzhuo Wang , Qiang Fu , Shi Han , Dongmei Zhang

Column Type Annotation (CTA) is a fundamental step towards enabling schema alignment and semantic understanding of tabular data. Existing encoder-only language models achieve high accuracy when fine-tuned on labeled columns, but their…

Databases · Computer Science 2025-12-30 Hanze Meng , Jianhao Cao , Rachel Pottinger

The conventional modus operandi for adapting pre-trained vision-language models (VLMs) during test-time involves tuning learnable prompts, ie, test-time prompt tuning. This paper introduces Test-Time Low-rank adaptation (TTL) as an…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Raza Imam , Hanan Gani , Muhammad Huzaifa , Karthik Nandakumar

Explaining predictions based on multivariate time series data carries the additional difficulty of handling not only multiple features, but also time dependencies. It matters not only what happened, but also when, and the same feature could…

Machine Learning · Computer Science 2023-05-31 Joseph Enguehard

Traditional test-time adaptation (TTA) methods face significant challenges in adapting to dynamic environments characterized by continuously changing long-term target distributions. These challenges primarily stem from two factors:…

Machine Learning · Computer Science 2023-11-10 Fahim Faisal Niloy , Sk Miraj Ahmed , Dripta S. Raychaudhuri , Samet Oymak , Amit K. Roy-Chowdhury

Adapting pre-trained language models (PLMs) for time-series text classification amidst evolving domain shifts (EDS) is critical for maintaining accuracy in applications like stance detection. This study benchmarks the effectiveness of…

Test-time adaptation (TTA) in federated learning (FL) is crucial for handling unseen data distributions across clients, particularly when faced with domain shifts and skewed class distributions. Class Imbalance (CI) remains a fundamental…

Existing test-time adaptation (TTA) approaches often adapt models with the unlabeled testing data stream. A recent attempt relaxed the assumption by introducing limited human annotation, referred to as Human-In-the-Loop Test-Time Adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Yushu Li , Yongyi Su , Xulei Yang , Kui Jia , Xun Xu

Convolutional Neural Networks (ConvNets) are trained offline using the few available data and may therefore suffer from substantial accuracy loss when ported on the field, where unseen input patterns received under unpredictable external…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Luca Mocerino , Roberto G. Rizzo , Valentino Peluso , Andrea Calimera , Enrico Macii

Continual learning empowers models to adapt autonomously to the ever-changing environment or data streams without forgetting old knowledge. Prompt-based approaches are built on frozen pre-trained models to learn the task-specific prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhanxin Gao , Jun Cen , Xiaobin Chang

Deep neural networks often suffer performance degradation upon deployment due to distribution shifts. Continual Test-Time Adaptation (CTTA) aims to address this issue in an unsupervised manner. However, existing methods that rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Xiao Chen , Jiazhen Huang , Zhiming Liu , Qinting Jiang , Fanding Huang , Jingyan Jiang , Zhi Wang

Test-time adaptation (TTA) adapts pre-trained models to distribution shifts at inference using only unlabeled test data. Under the Practical TTA (PTTA) setting, where test streams are temporally correlated and non-i.i.d., memory has become…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yu-Wen Tseng , Xingyi Zheng , Ya-Chen Wu , I-Bin Liao , Yung-Hui Li , Hong-Han Shuai , Wen-Huang Cheng

Despite their recent success, deep neural networks continue to perform poorly when they encounter distribution shifts at test time. Many recently proposed approaches try to counter this by aligning the model to the new distribution prior to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Samarth Sinha , Peter Gehler , Francesco Locatello , Bernt Schiele

Continual test-time domain adaptation (CTTA) aims to adjust pre-trained source models to perform well over time across non-stationary target environments. While previous methods have made considerable efforts to optimize the adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yanshuo Wang , Xuesong Li , Jinguang Tong , Jie Hong , Jun Lan , Weiqiang Wang , Huijia Zhu , Haoxing Chen

Test-Time Adaptation (TTA) aims to mitigate distributional shifts between training and test domains during inference time. However, existing TTA methods fall short in the realistic scenario where models face both continually changing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yingkai Yang , Chaoqi Chen , Hui Huang

Machine learning surrogates are increasingly used in engineering to accelerate costly simulations, yet distribution shifts between training and deployment often cause severe performance degradation (e.g., unseen geometries or…

Machine Learning · Computer Science 2026-02-18 Anna Zimmel , Paul Setinek , Gianluca Galletti , Johannes Brandstetter , Werner Zellinger

User modeling in large e-commerce platforms aims to optimize user experiences by incorporating various customer activities. Traditional models targeting a single task often focus on specific business metrics, neglecting the comprehensive…

Information Retrieval · Computer Science 2025-02-28 Mingdai Yang , Fan Yang , Yanhui Guo , Shaoyuan Xu , Tianchen Zhou , Yetian Chen , Simone Shao , Jia Liu , Yan Gao

Class-incremental learning (CIL) aims to learn new classes while retaining previous knowledge. Although pre-trained model (PTM) based approaches show strong performance, directly fine-tuning PTMs on incremental task streams often causes…

Machine Learning · Computer Science 2025-12-02 Zhiming Xu , Suorong Yang , Baile Xu , Furao Shen , Jian Zhao