中文
相关论文

相关论文: Vision Foundation Models in Medical Image Analysis…

200 篇论文

Foundation models have taken over natural language processing and image generation domains due to the flexibility of prompting. With the recent introduction of the Segment Anything Model (SAM), this prompt-driven paradigm has entered image…

图像与视频处理 · 电气工程与系统科学 2023-04-13 Saikat Roy , Tassilo Wald , Gregor Koehler , Maximilian R. Rokuss , Nico Disch , Julius Holzschuh , David Zimmerer , Klaus H. Maier-Hein

Recent advancements in pre-trained large foundation models (LFM) have yielded significant breakthroughs across various domains, including natural language processing and computer vision. These models have been particularly impactful in the…

图像与视频处理 · 电气工程与系统科学 2024-05-22 Ziqin Lin , Heng Li , Zinan Li , Huazhu Fu , Jiang Liu

Few-shot learning has been studied to adapt models to tasks with very few samples. It holds profound significance, particularly in clinical tasks, due to the high annotation cost of medical images. Several works have explored few-shot…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Kaipeng Zheng , Weiran Huang , Lichao Sun

Recent escalation in the field of computer vision underpins a huddle of algorithms with the magnificent potential to unravel the information contained within images. These computer vision algorithms are being practised in medical image…

图像与视频处理 · 电气工程与系统科学 2022-03-30 Arshi Parvaiz , Muhammad Anwaar Khalid , Rukhsana Zafar , Huma Ameer , Muhammad Ali , Muhammad Moazam Fraz

Stereo matching has become a key technique for 3D environment perception in intelligent vehicles. For a considerable time, convolutional neural networks (CNNs) have remained the mainstream choice for feature extraction in this domain.…

计算机视觉与模式识别 · 计算机科学 2024-04-10 Chuang-Wei Liu , Qijun Chen , Rui Fan

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

图像与视频处理 · 电气工程与系统科学 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

Background:Convolutional Neural Networks(CNN) and Vision Transformers(ViT) are the main techniques used in Medical image segmentation. However, CNN is limited to local contextual information, and ViT's quadratic complexity results in…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Xuanyu Liu , Huiyun Yao , Jinggui Gao , Zhongyi Guo , Xue Zhang , Yulin Dong

Scaling up model and data size have demonstrated impressive performance improvement over a wide range of tasks. Despite extensive studies on scaling behaviors for general-purpose tasks, medical images exhibit substantial differences from…

计算机视觉与模式识别 · 计算机科学 2025-05-15 Jiarun Liu , Hong-Yu Zhou , Weijian Huang , Hao Yang , Dongning Song , Tao Tan , Yong Liang , Shanshan Wang

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

计算机视觉与模式识别 · 计算机科学 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Foundation models (FMs) promise to generalize medical imaging, but their effectiveness varies. It remains unclear how pre-training domain (medical vs. general), paradigm (e.g., text-guided), and architecture influence embedding quality,…

While traditional computer vision models have historically struggled to generalize to endoscopic domains, the emergence of foundation models has shown promising cross-domain performance. In this work, we present the first large-scale study…

Visual segmentation seeks to partition images, video frames, or point clouds into multiple segments or groups. This technique has numerous real-world applications, such as autonomous driving, image editing, robot sensing, and medical…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Xiangtai Li , Henghui Ding , Haobo Yuan , Wenwei Zhang , Jiangmiao Pang , Guangliang Cheng , Kai Chen , Ziwei Liu , Chen Change Loy

Vision foundation models (VFMs) trained on large-scale image datasets provide high-quality features that have significantly advanced 2D visual recognition. However, their potential in 3D scene segmentation remains largely untapped, despite…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Karim Knaebel , Kadir Yilmaz , Daan de Geus , Alexander Hermans , David Adrian , Timm Linder , Bastian Leibe

Vision foundation models like the Segment Anything Model (SAM), pretrained on large-scale natural image datasets, often struggle in medical image segmentation due to a lack of domain-specific adaptation. In clinical practice, fine-tuning…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Zelin Liu , Sicheng Dong , Bocheng Li , Yixuan Yang , Jiacheng Ruan , Chenxu Zhou , Suncheng Xiang

Recent advancements in foundation models, typically trained with self-supervised learning on large-scale and diverse datasets, have shown great potential in medical image analysis. However, due to the significant spatial heterogeneity of…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Lingxiao Luo , Xuanzhong Chen , Bingda Tang , Xinsheng Chen , Rong Han , Chengpeng Hu , Yujiang Li , Ting Chen

Recently, the Segment Anything Model (SAM) has demonstrated promising segmentation capabilities in a variety of downstream segmentation tasks. However in the context of universal medical image segmentation there exists a notable performance…

图像与视频处理 · 电气工程与系统科学 2024-10-08 Chao Qin , Jiale Cao , Huazhu Fu , Fahad Shahbaz Khan , Rao Muhammad Anwer

The Segment Anything Model (SAM) has recently gained popularity in the field of image segmentation due to its impressive capabilities in various segmentation tasks and its prompt-based interface. However, recent studies and individual…

计算机视觉与模式识别 · 计算机科学 2024-01-01 Junde Wu , Wei Ji , Yuanpei Liu , Huazhu Fu , Min Xu , Yanwu Xu , Yueming Jin

The deployment of foundation models for medical imaging has demonstrated considerable success. However, their training overheads associated with downstream tasks remain substantial due to the size of the image encoders employed, and the…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Chengxi Zeng , Yuxuan Jiang , Fan Zhang , Alberto Gambaruto , Tilo Burghardt

Due to the increase in computational resources and accessibility of data, an increase in large, deep learning models trained on copious amounts of multi-modal data using self-supervised or semi-supervised learning have emerged. These…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Madeline Chantry Schiappa , Shehreen Azad , Sachidanand VS , Yunhao Ge , Ondrej Miksik , Yogesh S. Rawat , Vibhav Vineet

Foundation models are widely employed in medical image analysis, due to their high adaptability and generalizability for downstream tasks. With the increasing number of foundation models being released, model selection has become an…

图像与视频处理 · 电气工程与系统科学 2025-01-27 Fuping Wu , Bartlomiej W. Papiez