English
Related papers

Related papers: Revisiting 2D Foundation Models for Scalable 3D Me…

200 papers

Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in…

Machine Learning · Computer Science 2025-01-17 Wasif Khan , Seowung Leem , Kyle B. See , Joshua K. Wong , Shaoting Zhang , Ruogu Fang

Given the prevalence of 3D medical imaging technologies such as MRI and CT that are widely used in diagnosing and treating diverse diseases, 3D segmentation is one of the fundamental tasks of medical image analysis. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Yuhui Zhang , Shih-Cheng Huang , Zhengping Zhou , Matthew P. Lungren , Serena Yeung

Modern medical records include a vast amount of multimodal free text clinical data and imaging data from radiology, cardiology, and digital pathology. Fully mining such big data requires multitasking; otherwise, occult but important aspects…

Image and Video Processing · Electrical Eng. & Systems 2024-04-25 Chuang Niu , Qing Lyu , Christopher D. Carothers , Parisa Kaviani , Josh Tan , Pingkun Yan , Mannudeep K. Kalra , Christopher T. Whitlow , Ge Wang

Segmentation is a critical step in medical image analysis. Fully Convolutional Networks (FCNs) have emerged as powerful segmentation models achieving state-of-the-art results in various medical image datasets. Network architectures are…

Image and Video Processing · Electrical Eng. & Systems 2019-07-29 Maria G. Baldeon Calisto , Susana K. Lai-Yuen

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Salah Ghamizi , Georgia Kanli , Yu Deng , Magali Perquin , Olivier Keunen

The Segment Anything Model (SAM), originally built on a 2D Vision Transformer (ViT), excels at capturing global patterns in 2D natural images but struggles with 3D medical imaging modalities like CT and MRI. These modalities require…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiang Gao , Kai Lu

Structure-from-Motion (SfM), a task aiming at jointly recovering camera poses and 3D geometry of a scene given a set of images, remains a hard problem with still many open challenges despite decades of significant progress. The traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Bardienus Duisterhof , Lojze Zust , Philippe Weinzaepfel , Vincent Leroy , Yohann Cabon , Jerome Revaud

Volumetric medical image segmentation is pivotal in enhancing disease diagnosis, treatment planning, and advancing medical research. While existing volumetric foundation models for medical image segmentation, such as SAM-Med3D and SegVol,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Guoan Wang , Jin Ye , Junlong Cheng , Tianbin Li , Zhaolin Chen , Jianfei Cai , Junjun He , Bohan Zhuang

The rapid growth of medical imaging has fueled the development of Foundation Models (FMs) to reduce the growing, unsustainable workload on radiologists. While recent FMs have shown the power of large-scale pre-training to CT and MRI…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Antoine Saporta , Baptiste Callard , Corentin Dancette , Julien Khlaut , Charles Corbière , Leo Butsanets , Amaury Prat , Pierre Manceron

Depth estimation is a cornerstone of 3D reconstruction and plays a vital role in minimally invasive endoscopic surgeries. However, most current depth estimation networks rely on traditional convolutional neural networks, which are limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Bojian Li , Bo Liu , Xinning Yao , Jinghua Yue , Fugen Zhou

Vision-language models (VLMs) have shown promise in 2D medical image analysis, but extending them to 3D remains challenging due to the high computational demands of volumetric data and the difficulty of aligning 3D spatial features with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Yu Xin , Gorkem Can Ates , Kuang Gong , Wei Shao

Foundation models (FMs) have demonstrated strong performance across diverse pathology tasks. While there are similarities in the pre-training objectives of FMs, there is still limited understanding of their complementarity, redundancy in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Brennan Flannery , Thomas DeSilvio , Jane Nguyen , Satish E. Viswanath

Image segmentation remains a pivotal component in medical image analysis, aiding in the extraction of critical information for precise diagnostic practices. With the advent of deep learning, automated image segmentation methods have risen…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Nhat-Tan Bui , Dinh-Hieu Hoang , Minh-Triet Tran , Gianfranco Doretto , Donald Adjeroh , Brijesh Patel , Arabinda Choudhary , Ngan Le

The rapid proliferation of open-source medical foundation models (FMs) raises a practical question: how well do their pre-trained representations transfer to clinically relevant but data-scarce classification tasks? Particularly in CT-based…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Hartmut Häntze , Sarah de Boer , Myrthe Buser , Alessa Hering , Bram van Ginneken , Mathias Prokop , Jawed Nawabi , Sebastian Ziegelmayer , Lisa Adams , Keno Bressem

Computational pathology, which involves analyzing whole slide images for automated cancer diagnosis, relies on multiple instance learning, where performance depends heavily on the feature extractor and aggregator. Recent Pathology…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Conghao Xiong , Hao Chen , Joseph J. Y. Sung

Deep learning for medical image classification faces three major challenges: 1) the number of annotated medical images for training are usually small; 2) regions of interest (ROIs) are relatively small with unclear boundaries in the whole…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Shaohua Li , Yong Liu , Xiuchao Sui , Cheng Chen , Gabriel Tjio , Daniel Shu Wei Ting , Rick Siow Mong Goh

Depth estimation is a fundamental task in computer vision with diverse applications. Recent advancements in deep learning have led to powerful depth foundation models (DFMs), yet their evaluation remains challenging due to inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zhenyu Li , Haotong Lin , Jiashi Feng , Peter Wonka , Bingyi Kang

Promptable segmentation foundation models have emerged as a transformative approach to addressing the diverse needs in medical images, but most existing models require expensive computing, posing a big barrier to their adoption in clinical…

Promptable segmentation foundation models such as SAM3 have demonstrated strong generalization capabilities through interactive and concept-based prompting. However, their direct applicability to medical image segmentation remains limited…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Chongcong Jiang , Tianxingjian Ding , Chuhan Song , Jiachen Tu , Ziyang Yan , Yihua Shao , Zhenyi Wang , Yuzhang Shang , Tianyu Han , Yu Tian

Medical Foundation Models (MFMs), trained on large-scale datasets, have demonstrated superior performance across various tasks. However, these models still struggle with domain gaps in practical applications. Specifically, even after…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jia-Xuan Jiang , Wenhui Lei , Yifeng Wu , Hongtao Wu , Furong Li , Yining Xie , Xiaofan Zhang , Zhong Wang