中文
相关论文

相关论文: Prompt-Free and Efficient SAM2 Adaptation for Biom…

200 篇论文

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

The ability to segment objects based on open-ended language prompts remains a critical challenge, requiring models to ground textual semantics into precise spatial masks while handling diverse and unseen categories. We present OpenWorldSAM,…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Shiting Xiao , Rishabh Kabra , Yuhang Li , Donghyun Lee , Joao Carreira , Priyadarshini Panda

Although the Segment Anything Model (SAM) is highly effective in natural image segmentation, it requires dependencies on prompts, which limits its applicability to medical imaging where manual prompts are often unavailable. Existing efforts…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Mengmeng Zhang , Xingyuan Dai , Yicheng Sun , Jing Wang , Yueyang Yao , Xiaoyan Gong , Fuze Cong , Feiyue Wang , Yisheng Lv

Fully supervised deep learning (DL) models for surgical video segmentation have been shown to struggle with non-adversarial, real-world corruptions of image quality including smoke, bleeding, and low illumination. Foundation models for…

图像与视频处理 · 电气工程与系统科学 2024-08-19 Yiqing Shen , Hao Ding , Xinyuan Shao , Mathias Unberath

Medical image translation is crucial for reducing the need for redundant and expensive multi-modal imaging in clinical field. However, current approaches based on Convolutional Neural Networks (CNNs) and Transformers often fail to capture…

图像与视频处理 · 电气工程与系统科学 2024-11-21 Jiayu Huo , Sebastien Ourselin , Rachel Sparks

Recent "segment anything" efforts show promise by learning from large-scale data, but adapting such models directly to medical images remains challenging due to the complexity of medical data, noisy annotations, and continual learning…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Zhiling Yan , Sifan Song , Dingjie Song , Yiwei Li , Rong Zhou , Weixiang Sun , Zhennong Chen , Sekeun Kim , Hui Ren , Tianming Liu , Quanzheng Li , Xiang Li , Lifang He , Lichao Sun

Foundation models such as the recently introduced Segment Anything Model (SAM) have achieved remarkable results in image segmentation tasks. However, these models typically require user interaction through handcrafted prompts such as…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

Segmentation of anatomical structures and pathological regions in medical images is essential for modern clinical diagnosis, disease research, and treatment planning. While significant advancements have been made in deep learning-based…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao

Deep learning based methods often suffer from performance degradation caused by domain shift. In recent years, many sophisticated network structures have been designed to tackle this problem. However, the advent of large model trained on…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Zhikai Wei , Wenhui Dong , Peilin Zhou , Yuliang Gu , Zhou Zhao , Yongchao Xu

Despite the remarkable success of deep learning in medical imaging analysis, medical image segmentation remains challenging due to the scarcity of high-quality labeled images for supervision. Further, the significant domain gap between…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Hedda Cohen Indelman , Elay Dahan , Angeles M. Perez-Agosto , Carmit Shiran , Doron Shaked , Nati Daniel

The Segment Anything Model (SAM) and similar models build a family of promptable foundation models (FMs) for image and video segmentation. The object of interest is identified using prompts, such as bounding boxes or points. With these FMs…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Caroline Magg , Hoel Kervadec , Clara I. Sánchez

Medical image segmentation and video object segmentation are essential for diagnosing and analyzing diseases by identifying and measuring biological structures. Recent advances in natural domain have been driven by foundation models like…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Zhiling Yan , Weixiang Sun , Rong Zhou , Zhengqing Yuan , Kai Zhang , Yiwei Li , Tianming Liu , Quanzheng Li , Xiang Li , Lifang He , Lichao Sun

The Segment Anything Model (SAM) is widely used for segmenting a diverse range of objects in natural images from simple user prompts like points or bounding boxes. However, SAM's performance decreases substantially when applied to…

计算机视觉与模式识别 · 计算机科学 2025-04-24 Tristan Piater , Björn Barz , Alexander Freytag

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

Recent advancements in biomedical image analysis have been significantly driven by the Segment Anything Model (SAM). This transformative technology, originally developed for general-purpose computer vision, has found rapid application in…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Ho Hin Lee , Yu Gu , Theodore Zhao , Yanbo Xu , Jianwei Yang , Naoto Usuyama , Cliff Wong , Mu Wei , Bennett A. Landman , Yuankai Huo , Alberto Santamaria-Pang , Hoifung Poon

Vision foundation models have achieved remarkable progress across various image analysis tasks. In the image segmentation task, foundation models like the Segment Anything Model (SAM) enable generalizable zero-shot segmentation through…

计算机视觉与模式识别 · 计算机科学 2025-01-17 Xingxin He , Yifan Hu , Zhaoye Zhou , Mohamed Jarraya , Fang Liu

This paper provides insights on the effectiveness of the zero shot, prompt-based Segment Anything Model (SAM) and its updated versions, SAM 2 and SAM 2.1, along with the non-promptable conventional neural network (CNN), for segmenting solar…

计算机视觉与模式识别 · 计算机科学 2025-01-06 Osher Rafaeli , Tal Svoray , Roni Blushtein-Livnon , Ariel Nahlieli

The Segment Anything Model (SAM) is a recently proposed prompt-based segmentation model in a generic zero-shot segmentation approach. With the zero-shot segmentation capacity, SAM achieved impressive flexibility and precision on various…

计算机视觉与模式识别 · 计算机科学 2023-08-30 Can Cui , Ruining Deng , Quan Liu , Tianyuan Yao , Shunxing Bao , Lucas W. Remedios , Yucheng Tang , Yuankai Huo

The Segment Anything Model (SAM) has demonstrated impressive generalization in prompt-based segmentation. Yet, the potential of semantic text prompts remains underexplored compared to traditional spatial prompts like points and boxes. This…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Shayan Jalilian , Abdul Bais

While the Segment Anything Model (SAM) excels in semantic segmentation for general-purpose images, its performance significantly deteriorates when applied to medical images, primarily attributable to insufficient representation of medical…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Yiming Zhang , Tianang Leng , Kun Han , Xiaohui Xie