English
Related papers

Related papers: Uncovering Modality Discrepancy and Generalization…

200 papers

UNet has become the gold standard method for segmenting 2D medical images that any new method must be validated against. However, in recent years, several variations of the seminal UNet have been proposed with promising results. However,…

Medical image and video segmentation is a critical task for precision medicine, which has witnessed considerable progress in developing task or modality-specific and generalist models for 2D images. However, there have been limited studies…

Image and Video Processing · Electrical Eng. & Systems 2025-04-07 Jun Ma , Zongxin Yang , Sumin Kim , Bihui Chen , Mohammed Baharoon , Adibvafa Fallahpour , Reza Asakereh , Hongwei Lyu , Bo Wang

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Medical imaging is a cornerstone of modern healthcare, driving advancements in diagnosis, treatment planning, and patient care. Among its various tasks, segmentation remains one of the most challenging problem due to factors such as data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Fares Bougourzi , Abdenour Hadid

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

Most state-of-the-art techniques for medical image segmentation rely on deep-learning models. These models, however, are often trained on narrowly-defined tasks in a supervised fashion, which requires expensive labeled datasets. Recent…

Image and Video Processing · Electrical Eng. & Systems 2023-10-04 Heejong Kim , Victor Ion Butoi , Adrian V. Dalca , Daniel J. A. Margolis , Mert R. Sabuncu

3D image segmentation plays an important role in biomedical image analysis. Many 2D and 3D deep learning models have achieved state-of-the-art segmentation performance on 3D biomedical image datasets. Yet, 2D and 3D models have their own…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Hao Zheng , Yizhe Zhang , Lin Yang , Peixian Liang , Zhuo Zhao , Chaoli Wang , Danny Z. Chen

3D medical image classification is essential for modern clinical workflows. Medical foundation models (FMs) have emerged as a promising approach for scaling to new tasks, yet current research suffers from three critical pitfalls:…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Han Liu , Bogdan Georgescu , Yanbo Zhang , Youngjin Yoo , Michael Baumgartner , Riqiang Gao , Jianing Wang , Gengyan Zhao , Eli Gibson , Dorin Comaniciu , Sasa Grbic

We identify two major limitations in the existing studies on retinal vessel segmentation: (1) Most existing works are restricted to one modality, i.e., the Color Fundus (CF). However, multi-modality retinal images are used every day in the…

Image and Video Processing · Electrical Eng. & Systems 2026-01-01 Bo Wen , Anna Heinke , Akshay Agnihotri , Dirk-Uwe Bartsch , William Freeman , Truong Nguyen , Cheolhong An

Volumetric medical image segmentation is pivotal in enhancing disease diagnosis, treatment planning, and advancing medical research. While existing volumetric foundation models for medical image segmentation, such as SAM-Med3D and SegVol,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Guoan Wang , Jin Ye , Junlong Cheng , Tianbin Li , Zhaolin Chen , Jianfei Cai , Junjun He , Bohan Zhuang

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Recent advancements in foundation models have shown significant potential in medical image analysis. However, there is still a gap in models specifically designed for medical image localization. To address this, we introduce MedLAM, a 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Wenhui Lei , Xu Wei , Xiaofan Zhang , Kang Li , Shaoting Zhang

Multi-modal models require aligned, shared embedding spaces. However, common CLIP-based approaches need large amounts of samples and do not natively support 3D or tabular data, both of which are crucial in the medical domain. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Jakob Krogh Petersen , Valdemar Licht , Mads Nielsen , Asbjørn Munk

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

Multi-modality is widely used in medical imaging, because it can provide multiinformation about a target (tumor, organ or tissue). Segmentation using multimodality consists of fusing multi-information to improve the segmentation. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-17 Tongxue Zhou , Su Ruan , Stéphane Canu

While three-dimensional imaging is essential for clinical diagnosis, its high cost and long wait times have motivated the use of image-to-3D foundation models to infer volume from two-dimensional modalities. However, because these models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yan Luo , Advaith Ravishankar , Serena Liu , Yutong Yang , Mengyu Wang

In the paper, we present an approach for learning a single model that universally segments 33 anatomical structures, including vertebrae, pelvic bones, and abdominal organs. Our model building has to address the following challenges.…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Pengbo Liu , Yang Deng , Ce Wang , Yuan Hui , Qian Li , Jun Li , Shiwei Luo , Mengke Sun , Quan Quan , Shuxin Yang , You Hao , Honghu Xiao , Chunpeng Zhao , Xinbao Wu , S. Kevin Zhou

This article discusses the opportunities, applications and future directions of large-scale pre-trained models, i.e., foundation models, for analyzing medical images. Medical foundation models have immense potential in solving a wide range…

Image and Video Processing · Electrical Eng. & Systems 2023-11-23 Shaoting Zhang , Dimitris Metaxas

Constructing a robust model that can effectively generalize to test samples under distribution shifts remains a significant challenge in the field of medical imaging. The foundational models for vision and language, pre-trained on extensive…

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof