English
Related papers

Related papers: Modality-Projection Universal Model for Comprehens…

200 papers

Deep learning has shown significant value in medical image registration for motion correction, however, current techniques are either limited by the type and range of motion they can handle, or require iterative inference and/or retraining…

Image and Video Processing · Electrical Eng. & Systems 2026-05-04 Jian Wang , Razieh Faghihpirayesh , Danny Joca , Polina Golland , Ali Gholipour

Universal medical image segmentation models have emerged as a promising paradigm due to their strong generalizability across diverse tasks, showing great potential for a wide range of clinical applications. This potential has been partly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Yanwu Yang , Guinan Su , Jiesi Hu , Francesco Sammarco , Jonas Geiping , Thomas Wolfers

Accurately segmenting different organs from medical images is a critical prerequisite for computer-assisted diagnosis and intervention planning. This study proposes a deep learning-based approach for segmenting various organs from CT and…

The advancement of artificial intelligence (AI) for organ segmentation and tumor detection is propelled by the growing availability of computed tomography (CT) datasets with detailed, per-voxel annotations. However, these AI models often…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Jie Liu , Yixiao Zhang , Kang Wang , Mehmet Can Yavuz , Xiaoxi Chen , Yixuan Yuan , Haoliang Li , Yang Yang , Alan Yuille , Yucheng Tang , Zongwei Zhou

Universal medical image segmentation seeks to use a single foundational model to handle diverse tasks across multiple imaging modalities. However, existing approaches often rely heavily on manual visual prompts or retrieved reference…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Haoyun Chen , Fenghe Tang , Wenxin Ma , Shaohua Kevin Zhou

Different medical imaging modalities capture diagnostic information at varying spatial resolutions, from coarse global patterns to fine-grained localized structures. However, most existing vision-language frameworks in the medical domain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Shivang Chopra , Gabriela Sanchez-Rodriguez , Lingchao Mao , Andrew J Feola , Jing Li , Zsolt Kira

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Recent advancements in multimodal pre-training models have significantly advanced computational pathology. However, current approaches predominantly rely on visual-language models, which may impose limitations from a molecular perspective…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Minghao Han , Dingkang Yang , Jiabei Cheng , Xukun Zhang , Linhao Qu , Zizhi Chen , Lihua Zhang

Addressing missing modalities presents a critical challenge in multimodal learning. Current approaches focus on developing models that can handle modality-incomplete inputs during inference, assuming that the full set of modalities are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yunpeng Zhao , Cheng Chen , Qing You Pang , Quanzheng Li , Carol Tang , Beng-Ti Ang , Yueming Jin

Visual-language models have advanced the development of universal models, yet their application in medical imaging remains constrained by specific functional requirements and the limited data. Current general-purpose models are typically…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Kaini Wang , Ling Yang , Siping Zhou , Guangquan Zhou , Wentao Zhang , Bin Cui , Shuo Li

In clinical practice, medical segmentation datasets are often limited and heterogeneous, with variations in modalities, protocols, and anatomical targets across institutions. Existing deep learning models struggle to jointly learn from such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Weiwei Ma , Xiaobing Yu , Peijie Qiu , Jin Yang , Pan Xiao , Xiaoqi Zhao , Xiaofeng Liu , Tomo Miyazaki , Shinichiro Omachi , Yongsong Huang

In a research context, image acquisition will often involve a pre-defined static protocol and the data will be of high quality. If we are to build applications that work in hospitals without significant operational changes in care delivery,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Thomas Varsavsky , Zach Eaton-Rosen , Carole H. Sudre , Parashkev Nachev , M. Jorge Cardoso

Multimodal deep learning harnesses diverse imaging modalities, such as MRI sequences, to enhance diagnostic accuracy in medical imaging. A key challenge is determining the optimal timing for integrating these modalities-specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Valerio Guarrasi , Klara Mogensen , Sara Tassinari , Sara Qvarlander , Paolo Soda

Imaging with multiple modalities or multiple channels is becoming increasingly important for our modern society. A key tool for understanding and early diagnosis of cancer and dementia is PET-MR, a combined positron emission tomography and…

Image and Video Processing · Electrical Eng. & Systems 2020-07-24 Matthias J. Ehrhardt

Multi-modal medical imaging enables comprehensive diagnostics, yet current foundation models process 2D (e.g. X-ray) and 3D (e.g. CT) data with separate, dimensionality-specific architectures. We present MultiMedVision, a unified framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Frank Li , Bardia Khosravi , Mohammadreza Chavoshi , Young Seok Jeon , Theo Dapamede , Hari Trivedi , Janice Newsome , Judy Gichoya

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen

Deep models suffer from limited generalization capability to unseen domains, which has severely hindered their clinical applicability. Specifically for the retinal vessel segmentation task, although the model is supposed to learn the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Dewei Hu , Hao Li , Han Liu , Xing Yao , Jiacheng Wang , Ipek Oguz

Machine learning and deep learning methods have become essential for computer-assisted prediction in medicine, with a growing number of applications also in the field of mammography. Typically these algorithms are trained for a specific…

Image and Video Processing · Electrical Eng. & Systems 2021-12-03 Maria Wimmer , Gert Sluiter , David Major , Dimitrios Lenis , Astrid Berg , Theresa Neubauer , Katja Bühler

Statistical Shape Modeling (SSM) effectively analyzes anatomical variations within populations but is limited by the need for manual localization and segmentation, which relies on scarce medical expertise. Recent advances in deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Janmesh Ukey , Tushar Kataria , Shireen Y. Elhabian

Medical image registration is a fundamental task in medical image analysis, aiming to establish spatial correspondences between paired images. However, existing unsupervised deformable registration methods rely solely on intensity-based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Hao Xu , Tengfei Xue , Jianan Fan , Dongnan Liu , Yuqian Chen , Fan Zhang , Carl-Fredrik Westin , Ron Kikinis , Lauren J. O'Donnell , Weidong Cai