English
Related papers

Related papers: Tarot-SAM3: Training-free SAM3 for Any Referring E…

200 papers

Open-vocabulary semantic segmentation (OVSS) aims to segment and recognize objects universally. Trained on extensive high-quality segmentation data, the segment anything model (SAM) has demonstrated remarkable universal segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Lin Chen , Yingjian Zhu , Qi Yang , Xin Niu , Kun Ding , Shiming Xiang

Referring image segmentation aims to produce a pixel-level mask for the image region described by a natural-language expression. Although pretrained vision-language models have improved semantic grounding, many existing methods still rely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Alaa Dalaq , Muzammil Behzad

Promptable foundation models such as the Segment Anything Model (SAM) produce high-quality masks but remain semantically blind, relying on external prompts to specify categories. Existing vision-language approaches address this limitation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shayan Jalilian , Abdul Bais

We present SAM4EM, a novel approach for 3D segmentation of complex neural structures in electron microscopy (EM) data by leveraging the Segment Anything Model (SAM) alongside advanced fine-tuning strategies. Our contributions include the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Uzair Shah , Marco Agus , Daniya Boges , Vanessa Chiappini , Mahmood Alzubaidi , Jens Schneider , Markus Hadwiger , Pierre J. Magistretti , Mowafa Househ , Corrado Calı

Medical image segmentation has immense clinical applicability but remains a challenge despite advancements in deep learning. The Segment Anything Model (SAM) exhibits potential in this field, yet the requirement for expertise intervention…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Yinsong Xu , Jiaqi Tang , Aidong Men , Qingchao Chen

In this paper, we introduce InstructSAM, a unified and streamlined framework designed for multi-instance segmentation under arbitrary instructions. We formulates instruction-driven instance segmentation as a set-structured query prediction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yuqian Yuan , Wentong Li , Zhaocheng Li , Yutong Lin , Juncheng Li , Siliang Tang , Jun Xiao , Yueting Zhuang , Wenqiao Zhang

Large Vision--Language Models (LVLMs) hold great promise for advancing optical remote sensing (RS) analysis, yet existing reasoning segmentation frameworks couple linguistic reasoning and pixel prediction through end-to-end supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xu Zhang , Junyao Ge , Yang Zheng , Kaitai Guo , Jimin Liang

The recent SAM 3 and SAM 3D have introduced significant advancements over the predecessor, SAM 2, particularly with the integration of language-based segmentation and enhanced 3D perception capabilities. SAM 3 supports zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Wenzhen Dong , Jieming Yu , Yiming Huang , Hongqiu Wang , Lei Zhu , Albert C. S. Chung , Hongliang Ren , Long Bai

Open-set image segmentation poses a significant challenge because existing methods often demand extensive training or fine-tuning and generally struggle to segment unified objects consistently across diverse text reference expressions.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Zhihua Liu , Amrutha Saseendran , Lei Tong , Xilin He , Fariba Yousefi , Nikolay Burlutskiy , Dino Oglic , Tom Diethe , Philip Teare , Huiyu Zhou , Chen Jin

The recent introduction of \texttt{SAM3} has revolutionized Open-Vocabulary Segmentation (OVS) through \textit{promptable concept segmentation}, which grounds pixel predictions in flexible concept prompts. However, this reliance on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Gensheng Pei , Xiruo Jiang , Yazhou Yao , Xiangbo Shu , Fumin Shen , Byeungwoo Jeon

Interactive segmentation models such as the Segment Anything Model (SAM) have demonstrated remarkable generalization on natural images, but they perform suboptimally on remote sensing imagery (RSI) due to severe domain shifts and the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 M. Naseer Subhani

Promptable segmentation, introduced by the Segment Anything Model (SAM), is a promising approach for medical imaging, as it enables clinicians to guide and refine model predictions interactively. However, SAM's architecture is designed for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Théo Danielou , Daniel Tordjman , Pierre Manceron , Corentin Dancette

Referring expression comprehension (REC) and segmentation (RES) are two highly-related tasks, which both aim at identifying the referent according to a natural language expression. In this paper, we propose a novel Multi-task Collaborative…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Gen Luo , Yiyi Zhou , Xiaoshuai Sun , Liujuan Cao , Chenglin Wu , Cheng Deng , Rongrong Ji

The recent Segment Anything Model (SAM) demonstrates strong instance segmentation performance across various downstream tasks. However, SAM is trained solely on RGB data, limiting its direct applicability to RGB-thermal (RGB-T) semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dong Xing , Xianxun Zhu , Wei Zhou , Qika Lin , Hang Yang , Yuqing Wang

We present Seg-R1, a preliminary exploration of using reinforcement learning (RL) to enhance the pixel-level understanding and reasoning capabilities of large multimodal models (LMMs). Starting with foreground segmentation tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zuyao You , Zuxuan Wu

Verbal-prompted segmentation is inherently limited by the expressiveness of natural language and struggles with uncommon, instance-specific, or difficult-to-describe objects: scenarios frequently encountered in manufacturing and 3D printing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Zhenran Tang , Rohan Nagabhirava , Changliu Liu

Surgical image segmentation is essential for robot-assisted surgery and intraoperative guidance. However, existing methods are constrained to predefined categories, produce one-shot predictions without adaptive refinement, and lack…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Ange Lou , Yamin Li , Qi Chang , Nan Xi , Luyuan Xie , Zichao Li , Tianyu Luan

In the Complex Video Object Segmentation task, researchers are required to track and segment specific targets within cluttered environments, which rigorously tests a method's capability for target comprehension and environmental…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jinrong Zhang , Canyang Wu , Xusheng He , Weili Guan , Jianlong Wu , Liqiang Nie

Summary: SAMRI is an MRI-specialized adaptation of the Segment Anything Model achieving superior whole-body MRI segmentation, particularly for small and clinically critical structures, through box and point prompts for rapid annotation.…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Zhao Wang , Wei Dai , Thuy Thanh Dao , Steffen Bollmann , Hongfu Sun , Craig Engstrom , Shekhar S. Chandra

The rapid rise of large-scale foundation models has reshaped the landscape of image segmentation, with models such as Segment Anything achieving unprecedented versatility across diverse vision tasks. However, previous generations-including…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Tianrun Chen , Runlong Cao , Xinda Yu , Lanyun Zhu , Chaotao Ding , Deyi Ji , Cheng Chen , Qi Zhu , Chunyan Xu , Papa Mao , Ying Zang