English
Related papers

Related papers: Medal S: Spatio-Textual Prompt Model for Medical S…

200 papers

Referring Medical Image Sequence Segmentation (Ref-MISS) is a novel and challenging task that aims to segment anatomical structures in medical image sequences (\emph{e.g.} endoscopy, ultrasound, CT, and MRI) based on natural language…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Runtian Yuan , Mohan Chen , Jilan Xu , Ling Zhou , Qingqiu Li , Yuejie Zhang , Rui Feng , Tao Zhang , Shang Gao

Existing volumetric medical image segmentation models are typically task-specific, excelling at specific target but struggling to generalize across anatomical structures or modalities. This limitation restricts their broader clinical use.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Haoyu Wang , Sizheng Guo , Jin Ye , Zhongying Deng , Junlong Cheng , Tianbin Li , Jianpin Chen , Yanzhou Su , Ziyan Huang , Yiqing Shen , Bin Fu , Shaoting Zhang , Junjun He , Yu Qiao

Surgical instrument segmentation is an essential component of computer-assisted and robotic surgery systems. Vision-based segmentation models typically produce outputs limited to a predefined set of instrument categories, which restricts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Tae-Min Choi , Juyoun Park

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

Weakly-Supervised Semantic Segmentation (WSSS) aims to train segmentation models using image data with only image-level supervision. Since precise pixel-level annotations are not accessible, existing methods typically focus on producing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Ci-Siang Lin , Chien-Yi Wang , Yu-Chiang Frank Wang , Min-Hung Chen

In this work, we propose a novel straightforward method for medical volume and sequence segmentation with limited annotations. To avert laborious annotating, the recent success of self-supervised learning(SSL) motivates the pre-training on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Zejian Chen , Wei Zhuo , Tianfu Wang , Wufeng Xue , Dong Ni

End-to-end medical image segmentation is of great value for computer-aided diagnosis dominated by task-specific models, usually suffering from poor generalization. With recent breakthroughs brought by the segment anything model (SAM) for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xian Lin , Yangyang Xiang , Li Yu , Zengqiang Yan

Medical image segmentation is vital for clinical diagnosis and quantitative analysis, yet remains challenging due to the heterogeneity of imaging modalities and the high cost of pixel-level annotations. Although general interactive…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yujie Lu , Jingwen Li , Sibo Ju , Yanzhou Su , he yao , Yisong Liu , Min Zhu , Junlong Cheng

Open-vocabulary semantic segmentation aims to assign pixel-level labels to images across an unlimited range of classes. Traditional methods address this by sequentially connecting a powerful mask proposal generator, such as the Segment…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Minhyeok Lee , Suhwan Cho , Jungho Lee , Sunghun Yang , Heeseung Choi , Ig-Jae Kim , Sangyoun Lee

Historical maps offer valuable insights into changes on Earth's surface but pose challenges for modern segmentation models due to inconsistent visual styles and symbols. While deep learning models such as UNet and pre-trained foundation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yunshuang Yuan , Frank Thiemann , Thorsten Dahms , Monika Sester

Segment Anything Model 2 (SAM 2), a prompt-driven foundation model extending SAM to both image and video domains, has shown superior zero-shot performance compared to its predecessor. Building on SAM's success in medical image segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Bin Xie , Hao Tang , Yan Yan , Gady Agam

Delineating lesions and anatomical structure is important for image-guided interventions. Point-supervised medical image segmentation (PSS) has great potential to alleviate costly expert delineation labeling. However, due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xiaofeng Liu , Jonghye Woo , Chao Ma , Jinsong Ouyang , Georges El Fakhri

Recently, large vision model, Segment Anything Model (SAM), has revolutionized the computer vision field, especially for image segmentation. SAM presented a new promptable segmentation paradigm that exhibit its remarkable zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Chenglong Wang , Dexuan Li , Sucheng Wang , Chengxiu Zhang , Yida Wang , Yun Liu , Guang Yang

With the development of Deep Neural Networks (DNNs), many efforts have been made to handle medical image segmentation. Traditional methods such as nnUNet train specific segmentation models on the individual datasets. Plenty of recent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xiaobao Wei , Jiajun Cao , Yizhu Jin , Ming Lu , Guangyu Wang , Shanghang Zhang

Leveraging the extensive training data from SA-1B, the Segment Anything Model (SAM) demonstrates remarkable generalization and zero-shot capabilities. However, as a category-agnostic instance segmentation method, SAM heavily relies on prior…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Keyan Chen , Chenyang Liu , Hao Chen , Haotian Zhang , Wenyuan Li , Zhengxia Zou , Zhenwei Shi

Precise image segmentation provides clinical study with instructive information. Despite the remarkable progress achieved in medical image segmentation, there is still an absence of a 3D foundation segmentation model that can segment a wide…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Yuxin Du , Fan Bai , Tiejun Huang , Bo Zhao

We tackle the challenge of open-vocabulary segmentation, where we need to identify objects from a wide range of categories in different environments, using text prompts as our input. To overcome this challenge, existing methods often use…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yu-Jhe Li , Xinyang Zhang , Kun Wan , Lantao Yu , Ajinkya Kale , Xin Lu

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

Segment Anything Model (SAM) has demonstrated impressive zero-shot performance and brought a range of unexplored capabilities to natural image segmentation tasks. However, as a very important branch of image segmentation, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Xie , Hao Tang , Dawen Cai , Yan Yan , Gady Agam

Deep learning based methods often suffer from performance degradation caused by domain shift. In recent years, many sophisticated network structures have been designed to tackle this problem. However, the advent of large model trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Zhikai Wei , Wenhui Dong , Peilin Zhou , Yuliang Gu , Zhou Zhao , Yongchao Xu