中文
相关论文

相关论文: Uncovering Modality Discrepancy and Generalization…

200 篇论文

UNet has become the gold standard method for segmenting 2D medical images that any new method must be validated against. However, in recent years, several variations of the seminal UNet have been proposed with promising results. However,…

Medical image and video segmentation is a critical task for precision medicine, which has witnessed considerable progress in developing task or modality-specific and generalist models for 2D images. However, there have been limited studies…

图像与视频处理 · 电气工程与系统科学 2025-04-07 Jun Ma , Zongxin Yang , Sumin Kim , Bihui Chen , Mohammed Baharoon , Adibvafa Fallahpour , Reza Asakereh , Hongwei Lyu , Bo Wang

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Medical imaging is a cornerstone of modern healthcare, driving advancements in diagnosis, treatment planning, and patient care. Among its various tasks, segmentation remains one of the most challenging problem due to factors such as data…

计算机视觉与模式识别 · 计算机科学 2025-05-15 Fares Bougourzi , Abdenour Hadid

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

Most state-of-the-art techniques for medical image segmentation rely on deep-learning models. These models, however, are often trained on narrowly-defined tasks in a supervised fashion, which requires expensive labeled datasets. Recent…

图像与视频处理 · 电气工程与系统科学 2023-10-04 Heejong Kim , Victor Ion Butoi , Adrian V. Dalca , Daniel J. A. Margolis , Mert R. Sabuncu

3D image segmentation plays an important role in biomedical image analysis. Many 2D and 3D deep learning models have achieved state-of-the-art segmentation performance on 3D biomedical image datasets. Yet, 2D and 3D models have their own…

计算机视觉与模式识别 · 计算机科学 2018-12-11 Hao Zheng , Yizhe Zhang , Lin Yang , Peixian Liang , Zhuo Zhao , Chaoli Wang , Danny Z. Chen

3D medical image classification is essential for modern clinical workflows. Medical foundation models (FMs) have emerged as a promising approach for scaling to new tasks, yet current research suffers from three critical pitfalls:…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Han Liu , Bogdan Georgescu , Yanbo Zhang , Youngjin Yoo , Michael Baumgartner , Riqiang Gao , Jianing Wang , Gengyan Zhao , Eli Gibson , Dorin Comaniciu , Sasa Grbic

We identify two major limitations in the existing studies on retinal vessel segmentation: (1) Most existing works are restricted to one modality, i.e., the Color Fundus (CF). However, multi-modality retinal images are used every day in the…

图像与视频处理 · 电气工程与系统科学 2026-01-01 Bo Wen , Anna Heinke , Akshay Agnihotri , Dirk-Uwe Bartsch , William Freeman , Truong Nguyen , Cheolhong An

Volumetric medical image segmentation is pivotal in enhancing disease diagnosis, treatment planning, and advancing medical research. While existing volumetric foundation models for medical image segmentation, such as SAM-Med3D and SegVol,…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Guoan Wang , Jin Ye , Junlong Cheng , Tianbin Li , Zhaolin Chen , Jianfei Cai , Junjun He , Bohan Zhuang

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

计算机视觉与模式识别 · 计算机科学 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Recent advancements in foundation models have shown significant potential in medical image analysis. However, there is still a gap in models specifically designed for medical image localization. To address this, we introduce MedLAM, a 3D…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Wenhui Lei , Xu Wei , Xiaofan Zhang , Kang Li , Shaoting Zhang

Multi-modal models require aligned, shared embedding spaces. However, common CLIP-based approaches need large amounts of samples and do not natively support 3D or tabular data, both of which are crucial in the medical domain. To address…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Jakob Krogh Petersen , Valdemar Licht , Mads Nielsen , Asbjørn Munk

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

计算机视觉与模式识别 · 计算机科学 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

Multi-modality is widely used in medical imaging, because it can provide multiinformation about a target (tumor, organ or tissue). Segmentation using multimodality consists of fusing multi-information to improve the segmentation. Recently,…

图像与视频处理 · 电气工程与系统科学 2020-07-17 Tongxue Zhou , Su Ruan , Stéphane Canu

While three-dimensional imaging is essential for clinical diagnosis, its high cost and long wait times have motivated the use of image-to-3D foundation models to infer volume from two-dimensional modalities. However, because these models…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Yan Luo , Advaith Ravishankar , Serena Liu , Yutong Yang , Mengyu Wang

In the paper, we present an approach for learning a single model that universally segments 33 anatomical structures, including vertebrae, pelvic bones, and abdominal organs. Our model building has to address the following challenges.…

图像与视频处理 · 电气工程与系统科学 2022-03-07 Pengbo Liu , Yang Deng , Ce Wang , Yuan Hui , Qian Li , Jun Li , Shiwei Luo , Mengke Sun , Quan Quan , Shuxin Yang , You Hao , Honghu Xiao , Chunpeng Zhao , Xinbao Wu , S. Kevin Zhou

This article discusses the opportunities, applications and future directions of large-scale pre-trained models, i.e., foundation models, for analyzing medical images. Medical foundation models have immense potential in solving a wide range…

图像与视频处理 · 电气工程与系统科学 2023-11-23 Shaoting Zhang , Dimitris Metaxas

Constructing a robust model that can effectively generalize to test samples under distribution shifts remains a significant challenge in the field of medical imaging. The foundational models for vision and language, pre-trained on extensive…

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof