English
Related papers

Related papers: Gradient Alignment Improves Test-Time Adaptation f…

200 papers

We propose a model-agnostic, progressive test-time energy adaptation approach for medical image segmentation. Maintaining model performance across diverse medical datasets is challenging, as distribution shifts arise from inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Xiaoran Zhang , Byung-Woo Hong , Hyoungseob Park , Daniel H. Pak , Anne-Marie Rickmann , Lawrence H. Staib , James S. Duncan , Alex Wong

Domain Generalization (DG) research has gained considerable traction as of late, since the ability to generalize to unseen data distributions is a requirement that eludes even state-of-the-art training algorithms. In this paper we observe…

Machine Learning · Computer Science 2025-07-22 Aristotelis Ballas , Christos Diou

Online Test-Time Adaptation (OTTA) has emerged as an effective strategy to handle distributional shifts, allowing on-the-fly adaptation of pre-trained models to new target domains during inference, without the need for source data. We…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 WeiQin Chuah , Ruwan Tennakoon , Alireza Bab-Hadiashar

Data augmentation is an effective and universal technique for improving generalization performance of deep neural networks. It could enrich diversity of training samples that is essential in medical image segmentation tasks because 1) the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-29 Ju Xu , Mengzhang Li , Zhanxing Zhu

The use of semantic segmentation for masking and cropping input images has proven to be a significant aid in medical imaging classification tasks by decreasing the noise and variance of the training dataset. However, implementing this…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Kaiyang Cheng , Claudia Iriondo , Francesco Calivá , Justin Krogue , Sharmila Majumdar , Valentina Pedoia

Learning medical visual representations from paired images and reports is a promising direction in representation learning. However, current vision-language pretraining methods in the medical domain often simplify clinical reports into…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Wei Li , Xun Gong , Jiao Li , Xiaobin Sun

In medical image segmentation, domain generalization poses a significant challenge due to domain shifts caused by variations in data acquisition devices and other factors. These shifts are particularly pronounced in the most common…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Ruxue Wen , Hangjie Yuan , Dong Ni , Wenbo Xiao , Yaoyao Wu

Open-Set Domain Adaptation (OSDA) confronts the dual challenge of aligning known-class distributions across domains while identifying target-domain-specific unknown categories. Current approaches often fail to leverage semantic…

Machine Learning · Computer Science 2025-05-21 Haoyang Chen

In speech deepfake detection (SDD), data augmentation (DA) is commonly used to improve model generalization across varied speech conditions and spoofing attacks. However, during training, the backpropagated gradients from original and…

Sound · Computer Science 2026-01-29 Duc-Tuan Truong , Tianchi Liu , Junjie Li , Ruijie Tao , Kong Aik Lee , Eng Siong Chng

Leveraging pre-trained visual language models has become a widely adopted approach for improving performance in downstream visual question answering (VQA) applications. However, in the specialized field of medical VQA, the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Gang Liu , Hongyang Li , Zerui He , Shenjun Zhong

Stochastic gradient descent is a canonical tool for addressing stochastic optimization problems, and forms the bedrock of modern machine learning and statistics. In this work, we seek to balance the fact that attenuating step-size is…

Signal Processing · Electrical Eng. & Systems 2020-07-10 Zhan Gao , Alec Koppel , Alejandro Ribeiro

Semi-supervised learning has emerged as a widely adopted technique in the field of medical image segmentation. The existing works either focuses on the construction of consistency constraints or the generation of pseudo labels to provide…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Ning Gao , Sanping Zhou , Le Wang , Nanning Zheng

This paper investigates test-time adaptation (TTA) for regression, where a regression model pre-trained in a source domain is adapted to an unknown target distribution with unlabeled target data. Although regression is one of the…

Machine Learning · Computer Science 2025-01-24 Kazuki Adachi , Shin'ya Yamaguchi , Atsutoshi Kumagai , Tomoki Hamagami

Deep neural networks often encounter significant performance drops while facing with domain shifts between training (source) and test (target) data. To address this issue, Test Time Adaptation (TTA) methods have been proposed to adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Siqi Luo , Yi Xin , Yuntao Du , Tao Tan , Guangtao Zhai , Xiaohong Liu

Road segmentation from remote sensing images is a challenging task with wide ranges of application potentials. Deep neural networks have advanced this field by leveraging the power of large-scale labeled data, which, however, are extremely…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Lefei Zhang , Meng Lan , Jing Zhang , Dacheng Tao

Gradient-based iterative optimization methods are the workhorse of modern machine learning. They crucially rely on careful tuning of parameters like learning rate and momentum. However, one typically sets them using heuristic approaches…

Machine Learning · Computer Science 2025-12-05 Dravyansh Sharma

Utilizing well-trained representations in transfer learning often results in superior performance and faster convergence compared to training from scratch. However, even if such good representations are transferred, a model can easily…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 SeokHyun Seo , Jinwoo Hong , JungWoo Chae , Kyungyul Kim , Sangheum Hwang

Non-rigid registration is a necessary but challenging task in medical imaging studies. Recently, unsupervised registration models have shown good performance, but they often require a large-scale training dataset and long training times.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Heejung Park , Gyeong Min Lee , Soopil Kim , Ga Hyung Ryu , Areum Jeong , Sang Hyun Park , Min Sagong

Test-Time Adaptation (TTA) addresses domain shifts between training and testing. However, existing methods assume a homogeneous target domain (e.g., single domain) at any given time. They fail to handle the dynamic nature of real-world…

Machine Learning · Computer Science 2025-12-25 Chuyang Ye , Dongyan Wei , Zhendong Liu , Yuanyi Pang , Yixi Lin , Qinting Jiang , Jingyan Jiang , Dongbiao He

The ability to scene understanding in adverse visual conditions, e.g., nighttime, has sparked active research for RGB-Thermal (RGB-T) semantic segmentation. However, it is essentially hampered by two critical problems: 1) the day-night gap…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yexin Liu , Weiming Zhang , Guoyang Zhao , Jinjing Zhu , Athanasios Vasilakos , Lin Wang