English
Related papers

Related papers: Revisiting 2D Foundation Models for Scalable 3D Me…

200 papers

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

Foundation models for interactive segmentation in 2D natural images and videos have sparked significant interest in building 3D foundation models for medical imaging. However, the domain gaps and clinical use cases for 3D medical imaging…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yufan He , Pengfei Guo , Yucheng Tang , Andriy Myronenko , Vishwesh Nath , Ziyue Xu , Dong Yang , Can Zhao , Benjamin Simon , Mason Belue , Stephanie Harmon , Baris Turkbey , Daguang Xu , Wenqi Li

Domain shift presents a significant challenge in applying Deep Learning to the segmentation of 3D medical images from sources like Magnetic Resonance Imaging (MRI) and Computed Tomography (CT). Although numerous Domain Adaptation methods…

Image and Video Processing · Electrical Eng. & Systems 2025-02-25 Boris Shirokikh , Anvar Kurmukov , Mariia Donskova , Valentin Samokhin , Mikhail Belyaev , Ivan Oseledets

While emerging 3D medical foundation models are envisioned as versatile tools with offer general-purpose capabilities, their validation remains largely confined to regional and structural imaging, leaving a significant modality discrepancy…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yichi Zhang , Feiyang Xiao , Le Xue , Wenbo Zhang , Gang Feng , Chenguang Zheng , Yuan Qi , Yuan Cheng , Zixin Hu

In this study, we aim to initiate the development of Radiology Foundation Model, termed as RadFM. We consider the construction of foundational models from three perspectives, namely, dataset construction, model design, and thorough…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Chaoyi Wu , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

Spatial intelligence, encompassing 3D reconstruction, perception, and reasoning, is fundamental to applications such as robotics, aerial imaging, and extended reality. A key enabler is the real-time, accurate estimation of core 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Wenyan Cong , Yiqing Liang , Yancheng Zhang , Ziyi Yang , Yan Wang , Boris Ivanovic , Marco Pavone , Chen Chen , Zhangyang Wang , Zhiwen Fan

Light sheet fluorescence microscopy (LSM) enables high-resolution, three-dimensional (3D) imaging of biological specimens, providing rich volumetric data for studying cellular organization, pathology, and vascular networks. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Adina Scheinfeld , Haotan Zhang , Shang Mu , Rudolf L. M. van Herten , Lucas Stoffl , Ali Erturk , Zhuhao Wu , Johannes C. Paetzold

Accurate 3D scene reconstruction is essential for numerous medical tasks. Given the challenges in obtaining ground truth data, there has been an increasing focus on self-supervised learning (SSL) for endoscopic depth estimation as a basis…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Beilei Cui , Long Bai , Mobarakol Islam , An Wang , Zhiqi Ma , Yiming Huang , Feng Li , Zhen Chen , Zhongliang Jiang , Nassir Navab , Hongliang Ren

Segmenting 3D blood vessels is a critical yet challenging task in medical image analysis. This is due to significant imaging modality-specific variations in artifacts, vascular patterns and scales, signal-to-noise ratios, and background…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Bastian Wittmann , Yannick Wattenberg , Tamaz Amiranashvili , Suprosanna Shit , Bjoern Menze

As data continues to grow in volume and complexity across domains such as finance, manufacturing, and healthcare, effective anomaly detection is essential for identifying irregular patterns that may signal critical issues. Recently,…

Machine Learning · Computer Science 2025-06-16 Jing Ren , Tao Tang , Hong Jia , Ziqi Xu , Haytham Fayek , Xiaodong Li , Suyu Ma , Xiwei Xu , Feng Xia

Depth estimation is a foundational component for 3D reconstruction in minimally invasive endoscopic surgeries. However, existing monocular depth estimation techniques often exhibit limited performance to the varying illumination and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xinning Yao , Bo Liu , Bojian Li , Jingjing Wang , Jinghua Yue , Fugen Zhou

Transfer learning has gained attention in medical image analysis due to limited annotated 3D medical datasets for training data-driven deep learning models in the real world. Existing 3D-based methods have transferred the pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Eunji Jun , Seungwoo Jeong , Da-Woon Heo , Heung-Il Suk

The automatic diagnosis of Parkinson's disease is in high clinical demand due to its prevalence and the importance of targeted treatment. Current clinical practice often relies on diagnostic biomarkers in QSM and NM-MRI images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Ding Shaodong , Liu Ziyang , Zhou Yijun , Liu Tao

Direct automatic segmentation of objects from 3D medical imaging, such as magnetic resonance (MR) imaging, is challenging as it often involves accurately identifying a number of individual objects with complex geometries within a large…

Image and Video Processing · Electrical Eng. & Systems 2021-09-23 Wei Dai , Boyeong Woo , Siyu Liu , Matthew Marques , Craig B. Engstrom , Peter B. Greer , Stuart Crozier , Jason A. Dowling , Shekhar S. Chandra

Medical image analysis is essential to clinical diagnosis and treatment, which is increasingly supported by multi-modal large language models (MLLMs). However, previous research has primarily focused on 2D medical images, leaving 3D images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Fan Bai , Yuxin Du , Tiejun Huang , Max Q. -H. Meng , Bo Zhao

Medical image segmentation is crucial for clinical diagnosis. The Segmentation Anything Model (SAM) serves as a powerful foundation model for visual segmentation and can be adapted for medical image segmentation. However, medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Yuxi Liu , Guibo Luo , Yuesheng Zhu

Prompt-driven vision foundation models, such as the Segment Anything Model, have recently demonstrated remarkable adaptability in computer vision. However, their direct application to medical imaging remains challenging due to heterogeneous…

Image and Video Processing · Electrical Eng. & Systems 2025-11-14 Himashi Peiris , Sizhe Wang , Gary Egan , Mehrtash Harandi , Meng Law , Zhaolin Chen

3D medical image analysis is of great importance in disease diagnosis and treatment. Recently, multimodal large language models (MLLMs) have exhibited robust perceptual capacity, strong cross-modal alignment, and promising generalizability.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yang Yu , Dunyuan Xu , Yaoqian Li , Xiaomeng Li , Jinpeng Li , Pheng-Ann Heng

Fueled by recent advances in machine learning, there has been tremendous progress in the field of semantic segmentation for the medical image computing community. However, developed algorithms are often optimized and validated by hand based…

Image and Video Processing · Electrical Eng. & Systems 2020-05-21 Oliver Rippel , Leon Weninger , Dorit Merhof