English
Related papers

Related papers: Test-Time Modality Generalization for Medical Imag…

200 papers

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

Despite domain generalization (DG) has significantly addressed the performance degradation of pre-trained models caused by domain shifts, it often falls short in real-world deployment. Test-time adaptation (TTA), which adjusts a learned…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Xingguo Lv , Xingbo Dong , Liwen Wang , Jiewen Yang , Lei Zhao , Bin Pu , Zhe Jin , Xuejun Li

Semantic medical image segmentation using deep learning has recently achieved high accuracy, making it appealing to clinical problems such as radiation therapy. However, the lack of high-quality semantically labelled data remains a…

Image and Video Processing · Electrical Eng. & Systems 2023-03-13 Wei Dai , Siyu Liu , Craig B. Engstrom , Shekhar S. Chandra

While deep learning models have become the predominant method for medical image segmentation, they are typically not capable of generalizing to unseen segmentation tasks involving new anatomies, image modalities, or labels. Given a new…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Victor Ion Butoi , Jose Javier Gonzalez Ortiz , Tianyu Ma , Mert R. Sabuncu , John Guttag , Adrian V. Dalca

Medical image segmentation is a fundamental task in numerous medical engineering applications. Recently, language-guided segmentation has shown promise in medical scenarios where textual clinical reports are readily available as semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Mingjian Li , Mingyuan Meng , Shuchang Ye , Michael Fulham , Lei Bi , Jinman Kim

Due to the cross-domain distribution shift aroused from diverse medical imaging systems, many deep learning segmentation methods fail to perform well on unseen data, which limits their real-world applicability. Recent works have shown the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Shangqi Gao , Hangqi Zhou , Yibo Gao , Xiahai Zhuang

Single-source domain generalization (SDG) aims to learn a model from a single source domain that can generalize well on unseen target domains. This is an important task in computer vision, particularly relevant to medical imaging where…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Boqi Chen , Yuanzhi Zhu , Yunke Ao , Sebastiano Caprara , Reto Sutter , Gunnar Rätsch , Ender Konukoglu , Anna Susmelj

Multi-source synsemantic domain generalization (MSSDG) for multi-task remote physiological measurement seeks to enhance the generalizability of these metrics and attracts increasing attention. However, challenges like partial labeling and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Jiyao Wang , Xiao Yang , Hao Lu , Dengbo He , Kaishun Wu

Generalizability in deep neural networks plays a pivotal role in medical image segmentation. However, deep learning-based medical image analyses tend to overlook the importance of frequency variance, which is critical element for achieving…

Image and Video Processing · Electrical Eng. & Systems 2024-05-13 Ju-Hyeon Nam , Nur Suriza Syazwany , Su Jung Kim , Sang-Chul Lee

This study presents Medical Vision Generalist (MVG), the first foundation model capable of handling various medical imaging tasks -- such as cross-modal synthesis, image segmentation, denoising, and inpainting -- within a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Sucheng Ren , Xiaoke Huang , Xianhang Li , Junfei Xiao , Jieru Mei , Zeyu Wang , Alan Yuille , Yuyin Zhou

We consider the problem of improving the human instance segmentation mask quality for a given test image using keypoints estimation. We compare two alternative approaches. The first approach is a test-time adaptation (TTA) method, where we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Kambiz Azarian , Debasmit Das , Hyojin Park , Fatih Porikli

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

In real-world scenarios, achieving domain generalization (DG) presents significant challenges as models are required to generalize to unknown target distributions. Generalizing to unseen multi-modal distributions poses even greater…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Hao Dong , Ismail Nejjar , Han Sun , Eleni Chatzi , Olga Fink

Efficient medical image segmentation aims to provide accurate pixel-wise predictions for medical images with a lightweight implementation framework. However, lightweight frameworks generally fail to achieve superior performance and suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xingqun Qi , Zhuojie Wu , Min Ren , Muyi Sun , Caifeng Shan , Zhenan Sun

Versatile medical image segmentation (VMIS) targets the segmentation of multiple classes, while obtaining full annotations for all classes is often impractical due to the time and labor required. Leveraging partially labeled datasets (PLDs)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Shengqian Zhu , Jiafei Wu , Xiaogang Xu , Chengrong Yu , Ying Song , Zhang Yi , Guangjun Li , Junjie Hu

Medical image segmentation of tumors and organs at risk is a time-consuming yet critical process in the clinic that utilizes multi-modality imaging (e.g, different acquisitions, data types, and sequences) to increase segmentation precision.…

Image and Video Processing · Electrical Eng. & Systems 2023-06-07 Qisheng He , Nicholas Summerfield , Ming Dong , Carri Glide-Hurst

Synthesizing missing modalities in multi-modal magnetic resonance imaging (MRI) is vital for ensuring diagnostic completeness, particularly when full acquisitions are infeasible due to time constraints, motion artifacts, and patient…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yue Zhang , Zhizheng Zhuo , Siyao Xu , Shan Lv , Zhaoxi Liu , Jun Qiu , Qiuli Wang , Yaou Liu , S. Kevin Zhou

The integration of deep learning in medical imaging has shown great promise for enhancing diagnostic, therapeutic, and research outcomes. However, applying universal models across multiple modalities remains challenging due to the inherent…

Image and Video Processing · Electrical Eng. & Systems 2024-12-30 Yixin Chen , Lin Gao , Yajuan Gao , Rui Wang , Jingge Lian , Xiangxi Meng , Yanhua Duan , Leiying Chai , Hongbin Han , Zhaoping Cheng , Zhaoheng Xie

In the field of medical image segmentation, the scarcity of labeled data poses a major challenge for existing models to accurately perceive target regions. Compared with manual annotation, gaze data is easier and cheaper to obtain. As a…

Image and Video Processing · Electrical Eng. & Systems 2026-04-14 Rongjun Ge , Chong Wang , Yuxin Liu , Chunqiang Lu , Cong Xia , Yehui Jiang , Fangyi Xu , Yinsu Zhu , Daoqiang Zhang , Chengyu Liu , Yang Chen , Shuo Li , Yuting He