English
Related papers

Related papers: Medal S: Spatio-Textual Prompt Model for Medical S…

200 papers

Deep learning-based medical image segmentation typically requires large amount of labeled data for training, making it less applicable in clinical settings due to high annotation cost. Semi-supervised learning (SSL) has emerged as an…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Yichi Zhang , Bohao Lv , Le Xue , Wenbo Zhang , Yuchen Liu , Yu Fu , Yuan Cheng , Yuan Qi

Recent advances in point cloud perception have demonstrated remarkable progress in scene understanding through vision-language alignment leveraging large language models (LLMs). However, existing methods may still encounter challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zhenhua Ning , Zhuotao Tian , Shaoshuai Shi , Guangming Lu , Daojing He , Wenjie Pei , Li Jiang

In contemporary surgical research and practice, accurately comprehending 3D surgical scenes with text-promptable capabilities is particularly crucial for surgical planning and real-time intra-operative guidance, where precisely identifying…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Yiming Huang , Long Bai , Beilei Cui , Kun Yuan , Guankun Wang , Mobarak I. Hoque , Nicolas Padoy , Nassir Navab , Hongliang Ren

Referring 3D Segmentation is a visual-language task that segments all points of the specified object from a 3D point cloud described by a sentence of query. Previous works perform a two-stage paradigm, first conducting language-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Xuexun Liu , Xiaoxu Xu , Jinlong Li , Qiudan Zhang , Xu Wang , Nicu Sebe , Lin Ma

The Segment Anything Model (SAM) has garnered significant attention for its versatile segmentation abilities and intuitive prompt-based interface. However, its application in medical imaging presents challenges, requiring either substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Zhiheng Cheng , Qingyue Wei , Hongru Zhu , Yan Wang , Liangqiong Qu , Wei Shao , Yuyin Zhou

Audio-visual semantic segmentation (AVSS) represents an extension of the audio-visual segmentation (AVS) task, necessitating a semantic understanding of audio-visual scenes beyond merely identifying sound-emitting objects at the visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yujian Lee , Peng Gao , Yongqi Xu , Wentao Fan

Medical image segmentation is a crucial and time-consuming task in clinical care, where mask precision is extremely important. The Segment Anything Model (SAM) offers a promising approach, as it provides an interactive interface based on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Julien Khlaut , Elodie Ferreres , Daniel Tordjman , Hélène Philippe , Tom Boeken , Pierre Manceron , Corentin Dancette

Diffusion Probabilistic Models (DPMs) have demonstrated significant potential in 3D medical image segmentation tasks. However, their high computational cost and inability to fully capture global 3D contextual information limit their…

Image and Video Processing · Electrical Eng. & Systems 2025-04-17 Kangbo Ma

The development of machine learning models for CT imaging depends on the availability of large, high-quality, and diverse annotated datasets. Although large volumes of CT images and reports are readily available in clinical picture…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Samuel Church , Joshua D. Warner , Danyal Maqbool , Xin Tie , Junjie Hu , Meghan G. Lubner , Tyler J. Bradshaw

Medical image segmentation is fundamental for biomedical discovery. Existing methods lack generalizability and demand extensive, time-consuming manual annotation for new clinical application. Here, we propose MedSAM-3, a text promptable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Anglin Liu , Rundong Xue , Xu R. Cao , Yifan Shen , Yi Lu , Xiang Li , Qianqian Chen , Jintai Chen

Adapting large pre-trained foundation models, e.g., SAM, for medical image segmentation remains a significant challenge. A crucial step involves the formulation of a series of specialized prompts that incorporate specific clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiuqi Zheng , Yuhang Zhang , Haoran Zhang , Hongrui Liang , Xueqi Bao , Zhuqing Jiang , Qicheng Lao

The universal model emerges as a promising trend for medical image segmentation, paving up the way to build medical imaging large model (MILM). One popular strategy to build universal models is to encode each task as a one-hot vector and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Yiwen Ye , Yutong Xie , Jianpeng Zhang , Ziyang Chen , Yong Xia

Recent advances in promptable segmentation, such as the Segment Anything Model (SAM), have enabled flexible, high-quality mask generation across a wide range of visual domains. However, SAM and similar models remain fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Tyler Ward , Abdullah Imran

In clinical practice, segmenting specific lesions based on the needs of physicians can significantly enhance diagnostic accuracy and treatment efficiency. However, conventional lesion segmentation models lack the flexibility to distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shuyi Ouyang , Jinyang Zhang , Xiangye Lin , Xilai Wang , Qingqing Chen , Yen-Wei Chen , Lanfen Lin

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

In this paper, we present PRISM, a Promptable and Robust Interactive Segmentation Model, aiming for precise segmentation of 3D medical images. PRISM accepts various visual inputs, including points, boxes, and scribbles as sparse prompts, as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hao Li , Han Liu , Dewei Hu , Jiacheng Wang , Ipek Oguz

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae

Foundation models like the segment anything model require high-quality manual prompts for medical image segmentation, which is time-consuming and requires expertise. SAM and its variants often fail to segment structures in ultrasound (US)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Assefa Seyoum Wahd , Banafshe Felfeliyan , Yuyue Zhou , Shrimanti Ghosh , Adam McArthur , Jiechen Zhang , Jacob L. Jaremko , Abhilash Hareendranathan

Despite remarkable advancements in pixel-level medical image perception, existing methods are either limited to specific tasks or heavily rely on accurate bounding boxes or text labels as input prompts. However, the medical knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Qinyue Tong , Ziqian Lu , Jun Liu , Yangming Zheng , Zheming Lu

Segmentation is central to clinical diagnosis and monitoring, yet the reliability of modern foundation models in medical imaging still depends on the availability of precise prompts. The Segment Anything Model (SAM) offers powerful…