English
Related papers

Related papers: GuiDINO: Rethinking Vision Foundation Model in Med…

200 papers

The adoption of neural network models in medical imaging has been constrained by strict privacy regulations, limited data availability, high acquisition costs, and demographic biases. Deep generative models offer a promising solution by…

Image and Video Processing · Electrical Eng. & Systems 2025-06-16 Zuzanna Skorniewska , Bartlomiej W. Papiez

We present a semi-supervised framework for joint segmentation and classification of fetal cardiac ultrasound images. Built upon the EchoCare multi-task backbone, our method integrates SAM-Med2D for boundary refinement and leverages DINOv3…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Tonghao Zhuang , Shanglong Hu , Yongsheng Luo , Zhiqi Zhang , Yu Li

Foundation models have significantly enhanced 2D task performance, and recent works like Bridge3D have successfully applied these models to improve 3D scene understanding through knowledge distillation, marking considerable advancements.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Zhimin Chen , Liang Yang , Yingwei Li , Longlong Jing , Bing Li

General vision encoders like DINOv2 and SAM have recently transformed computer vision. Even though they are trained on natural images, such encoder models have excelled in medical imaging, e.g., in classification, segmentation, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Fryderyk Kögl , Anna Reithmeir , Vasiliki Sideri-Lampretsa , Ines Machado , Rickmer Braren , Daniel Rückert , Julia A. Schnabel , Veronika A. Zimmer

Precisely estimating lumen boundaries in intravascular ultrasound (IVUS) is needed for sizing interventional stents to treat deep vein thrombosis (DVT). Unfortunately, current segmentation networks like the UNet lack the precision needed…

Purpose: This study provides the first comprehensive evaluation of foundation models in fetal ultrasound (US) imaging under low inter-class variability conditions. While recent vision foundation models such as DINOv3 have shown remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Edoardo Conti , Riccardo Rosati , Lorenzo Federici , Adriano Mancini , Maria Chiara Fiorentin

Foundation models (e.g., CLIP or DINOv2) have shown their impressive learning and transfer capabilities in a wide range of visual tasks, by training on a large corpus of data and adapting to specific downstream tasks. It is, however,…

Machine Learning · Computer Science 2023-11-06 Bin Deng , Kui Jia

The rapid development of Vision Foundation Models (VFMs), particularly Vision Transformers (ViT) and Segment Anything Model (SAM), has sparked significant advances in the field of medical image analysis. These models have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-02-24 Pengchen Liang , Bin Pu , Haishan Huang , Yiwei Li , Hualiang Wang , Weibo Ma , Qing Chang

Vision foundation models have demonstrated exceptional generalization capabilities in segmentation tasks for both generic and specialized images. However, a performance gap persists between foundation models and task-specific, specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Chengxi Zeng , David Smithard , Alberto M Gambaruto , Tilo Burghardt

Unsupervised image segmentation is a critical task in computer vision. It enables dense scene understanding without human annotations, which is especially valuable in domains where labelled data is scarce. However, existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Boujemaa Guermazi , Riadh Ksantini , Naimul Khan

We propose EasyControlEdge, adapting an image-generation foundation model to edge detection. In real-world edge detection (e.g., floor-plan walls, satellite roads/buildings, and medical organ boundaries), crispness and data efficiency are…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Hiroki Nakamura , Hiroto Iino , Masashi Okada , Tadahiro Taniguchi

Foundation models open up new possibilities for the use of AI in healthcare. However, even when pre-trained on health data, they still need to be fine-tuned for specific downstream tasks. Furthermore, although foundation models reduce the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Adam Tupper , Christian Gagné

In this paper, we present SegDINO3D, a novel Transformer encoder-decoder framework for 3D instance segmentation. As 3D training data is generally not as sufficient as 2D training images, SegDINO3D is designed to fully leverage 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jinyuan Qu , Hongyang Li , Xingyu Chen , Shilong Liu , Yukai Shi , Tianhe Ren , Ruitao Jing , Lei Zhang

Model calibration measures the agreement between the predicted probability estimates and the true correctness likelihood. Proper model calibration is vital for high-risk applications. Unfortunately, modern deep neural networks are poorly…

Image and Video Processing · Electrical Eng. & Systems 2022-09-14 Skylar E. Stolte , Kyle Volle , Aprinda Indahlastari , Alejandro Albizu , Adam J. Woods , Kevin Brink , Matthew Hale , Ruogu Fang

Medical image segmentation is a pivotal task within the realms of medical image analysis and computer vision. While current methods have shown promise in accurately segmenting major regions of interest, the precise segmentation of boundary…

Image and Video Processing · Electrical Eng. & Systems 2025-05-09 Yi Lin , Dong Zhang , Xiao Fang , Yufan Chen , Kwang-Ting Cheng , Hao Chen

Guidewire segmentation during endovascular interventions holds the potential to significantly enhance procedural accuracy, improving visualization and providing critical feedback that can support both physicians and robotic systems in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yuxuan Wen , Evgenia Roussinova , Olivier Brina , Paolo Machi , Mohamed Bouri

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Accurate medical image segmentation plays a crucial role in overall diagnosis and is one of the most essential tasks in the diagnostic pipeline. CNN-based models, despite their extensive use, suffer from a local receptive field and fail to…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 Zulkaif Sajjad , Furqan Shaukat , Junaid Mir

Medical image segmentation is a fundamental task in the community of medical image analysis. In this paper, a novel network architecture, referred to as Convolution, Transformer, and Operator (CTO), is proposed. CTO employs a combination of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Yi Lin , Dong Zhang , Xiao Fang , Yufan Chen , Kwang-Ting Cheng , Hao Chen

Foundation models have transformed vision and language by learning general-purpose representations from large-scale unlabeled data, yet 3D medical imaging lacks analogous approaches. Existing self-supervised methods rely on low-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yunhe Gao , Yabin Zhang , Chong Wang , Jiaming Liu , Maya Varma , Jean-Benoit Delbrouck , Akshay Chaudhari , Curtis Langlotz