中文
相关论文

相关论文: FoCTTA: Low-Memory Continual Test-Time Adaptation …

200 篇论文

Block-sequential continual learning demands that a single model both protect prior solutions from catastrophic forgetting and efficiently infer at inference time which prior solution matches the current input without task labels. We present…

机器学习 · 计算机科学 2026-05-01 Kevin McKee , Thomas Hazy , Yicong Zheng , Zacharie Bugaud , Thomas Miconi

Distribution shift (e.g., task or domain shift) in continual learning (CL) usually results in catastrophic forgetting of neural networks. Although it can be alleviated by repeatedly replaying buffered data, the every-step replay is…

机器学习 · 计算机科学 2023-04-11 Haiyan Zhao , Tianyi Zhou , Guodong Long , Jing Jiang , Chengqi Zhang

Large pre-trained models are commonly adapted to downstream tasks using parameter-efficient fine-tuning methods such as Low-Rank Adaptation (LoRA), which injects small trainable low-rank matrices instead of updating all weights. While LoRA…

机器学习 · 计算机科学 2026-03-10 Nurbek Tastan , Stefanos Laskaridis , Martin Takac , Karthik Nandakumar , Samuel Horvath

Parameter-Efficient Fine-Tuning (PEFT), particularly Low-Rank Adaptation (LoRA), has become a standard approach for adapting Large Language Models (LLMs) under limited compute. However, in continual settings where models are updated…

机器学习 · 计算机科学 2026-05-14 Hung Le , Svetha Venkatesh

Test-time augmentation (TTA) has become a promising approach for mitigating data sparsity in sequential recommendation by improving inference accuracy without requiring costly model retraining. However, existing TTA methods typically rely…

信息检索 · 计算机科学 2026-04-20 Xibo Li , Liang Zhang

Unsupervised Domain Adaptation (UDA) has emerged as a key solution in data-driven fault diagnosis, addressing domain shift where models underperform in changing environments. However, under the realm of continually changing environments,…

机器学习 · 计算机科学 2024-07-25 Edward , Mohamed Ragab , Yuecong Xu , Min Wu , Yuecong Xu , Zhenghua Chen , Abdulla Alseiari , Xiaoli Li

Test-time adaptation (TTA) in federated learning (FL) is crucial for handling unseen data distributions across clients, particularly when faced with domain shifts and skewed class distributions. Class Imbalance (CI) remains a fundamental…

We introduce Ev-TTA, a simple, effective test-time adaptation algorithm for event-based object recognition. While event cameras are proposed to provide measurements of scenes with fast motions or drastic illumination changes, many existing…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Junho Kim , Inwoo Hwang , Young Min Kim

Electroencephalogram (EEG)-based brain-computer interfaces (BCIs) face significant deployment challenges due to inter-subject variability, signal non-stationarity, and computational constraints. While test-time adaptation (TTA) mitigates…

人机交互 · 计算机科学 2026-01-13 Siyang Li , Jiayi Ouyang , Zhenyao Cui , Ziwei Wang , Tianwang Jia , Feng Wan , Dongrui Wu

Continual learning remains challenging due to catastrophic forgetting, where neural networks lose previously acquired knowledge when learning new tasks. Inspired by memory consolidation in neuroscience, we propose FSC-Net (Fast-Slow…

机器学习 · 计算机科学 2025-11-18 Mohamed El Gorrim

Given a model trained on source data, Test-Time Adaptation (TTA) enables adaptation and inference in test data streams with domain shifts from the source. Current methods predominantly optimize the model for each incoming test data batch…

机器学习 · 计算机科学 2024-07-18 Ziqiang Wang , Zhixiang Chi , Yanan Wu , Li Gu , Zhi Liu , Konstantinos Plataniotis , Yang Wang

Test-time adaptation (TTA) has recently emerged as a promising approach for improving time series forecasting (TSF) under distribution shift. Existing TSF-TTA methods differ in how they utilize revealed targets, yet the resulting adaptation…

机器学习 · 计算机科学 2026-05-19 Haochun Wang , Ruichen Xu , Georgios Kementzidis , Karen Cho , Sebastian Ramirez Villarreal , Yuefan Deng

Tabular data plays a vital role in various real-world scenarios and finds extensive applications. Although recent deep tabular models have shown remarkable success, they still struggle to handle data distribution shifts, leading to…

机器学习 · 计算机科学 2024-12-17 Zhi Zhou , Kun-Yang Yu , Lan-Zhe Guo , Yu-Feng Li

Foundation models pretrained on large-scale 3D medical imaging data face challenges when adapted to multiple downstream tasks under continual learning with limited labeled data. We address few-shot continual learning for 3D brain MRI by…

图像与视频处理 · 电气工程与系统科学 2026-03-02 Chi-Sheng Chen , Xinyu Zhang , Guan-Ying Chen , Qiuzhe Xie , Fan Zhang , En-Jui Kuo

Recent advances in model pre-training give rise to task adaptation-based few-shot learning (FSL), where the goal is to adapt a pre-trained task-agnostic model for capturing task-specific knowledge with a few-labeled support samples of the…

计算机视觉与模式识别 · 计算机科学 2025-06-23 Ji Zhang , Jingkuan Song , Lianli Gao , Nicu Sebe , Heng Tao Shen

Fully test-time adaptation aims at adapting a pre-trained model to the test stream during real-time inference, which is urgently required when the test distribution differs from the training distribution. Several efforts have been devoted…

机器学习 · 计算机科学 2023-01-31 Bowen Zhao , Chen Chen , Shu-Tao Xia

Test-Time Adaptation (TTA) methods improve the robustness of deep neural networks to domain shift on a variety of tasks such as image classification or segmentation. This work explores adapting segmentation models to a single unlabelled…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Klara Janouskova , Tamir Shor , Chaim Baskin , Jiri Matas

While current Vision Transformer (ViT) adapter methods have shown promising accuracy, their inference speed is implicitly hindered by inefficient memory access operations, e.g., standard normalization and frequent reshaping. In this work,…

计算机视觉与模式识别 · 计算机科学 2025-02-05 Dong Zhang , Rui Yan , Pingcheng Dong , Kwang-Ting Cheng

Continuous Video Domain Adaptation (CVDA) is a scenario where a source model is required to adapt to a series of individually available changing target domains continuously without source data or target supervision. It has wide…

计算机视觉与模式识别 · 计算机科学 2023-08-30 Xiyu Wang , Yuecong Xu , Jianfei Yang , Bihan Wen , Alex C. Kot

Test-Time Adaptation (TTA) has emerged as an effective solution for adapting Vision Transformers (ViT) to distribution shifts without additional training data. However, existing TTA methods often incur substantial computational overhead,…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Yizhe Xiong , Zihan Zhou , Yiwen Liang , Hui Chen , Zijia Lin , Tianxiang Hao , Fan Zhang , Jungong Han , Guiguang Ding