English
Related papers

Related papers: Tarot-SAM3: Training-free SAM3 for Any Referring E…

200 papers

3D part segmentation is a crucial and challenging task in 3D perception, playing a vital role in applications such as robotics, 3D generation, and 3D editing. Recent methods harness the powerful Vision Language Models (VLMs) for 2D-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yunhan Yang , Yukun Huang , Yuan-Chen Guo , Liangjun Lu , Xiaoyang Wu , Edmund Y. Lam , Yan-Pei Cao , Xihui Liu

Referring Expression Segmentation (RES) enables precise object segmentation in images based on natural language descriptions, offering high flexibility and broad applicability in real-world vision tasks. Despite its impressive performance,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xingbai Chen , Tingchao Fu , Renyang Liu , Wei Zhou , Chao Yi

We introduce SAM4MLLM, an innovative approach which integrates the Segment Anything Model (SAM) with Multi-Modal Large Language Models (MLLMs) for pixel-aware tasks. Our method enables MLLMs to learn pixel-level location information without…

Artificial Intelligence · Computer Science 2024-12-17 Yi-Chia Chen , Wei-Hua Li , Cheng Sun , Yu-Chiang Frank Wang , Chu-Song Chen

The Segment Anything Model 2 (SAM2) has recently demonstrated exceptional performance in zero-shot prompt segmentation for natural images and videos. However, when the propagation mechanism of SAM2 is applied to medical images, it often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yunhao Bai , Boxiang Yun , Zeli Chen , Qinji Yu , Yingda Xia , Yan Wang

Interactive segmentation is to segment the mask of the target object according to the user's interactive prompts. There are two mainstream strategies: early fusion and late fusion. Current specialist models utilize the early fusion strategy…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Chongkai Yu , Ting Liu , Anqi Li , Xiaochao Qu , Chengjing Wu , Luoqi Liu , Xiaolin Hu

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

The availability of large-scale remote sensing video data underscores the importance of high-quality interactive segmentation. However, challenges such as small object sizes, ambiguous features, and limited generalization make it difficult…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhe Shan , Yang Liu , Lei Zhou , Cheng Yan , Heng Wang , Xia Xie

Image segmentation beyond predefined categories is a key challenge in remote sensing, where novel and unseen classes often emerge during inference. Open-vocabulary image Segmentation addresses these generalization issues in traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Saikat Dutta , Akhil Vasim , Siddhant Gole , Hamid Rezatofighi , Biplab Banerjee

Referring expression segmentation aims to segment an object described by a language expression from an image. Despite the recent progress on this task, existing models tackling this task may not be able to fully capture semantics and visual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Li Xu , Mark He Huang , Xindi Shang , Zehuan Yuan , Ying Sun , Jun Liu

We introduce SAMPro3D for zero-shot instance segmentation of 3D scenes. Given the 3D point cloud and multiple posed RGB-D frames of 3D scenes, our approach segments 3D instances by applying the pretrained Segment Anything Model (SAM) to 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Mutian Xu , Xingyilang Yin , Lingteng Qiu , Yang Liu , Xin Tong , Xiaoguang Han

The Segment Anything Model 3 (SAM3) advances visual understanding with Promptable Concept Segmentation (PCS) across images and videos, but its unified architecture (shared vision backbone, DETR-style detector, dense-memory tracker) remains…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Chengxi Zeng , Yuxuan Jiang , Aaron Zhang

Few-shot medical image segmentation (FSMIS) has achieved notable progress, yet most existing methods mainly rely on semantic correspondences from scarce annotations while under-utilizing a key property of medical imagery: anatomical targets…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhihao Mao , Bangpu Chen

Foundational models such as the Segment Anything Model (SAM) are gaining traction in medical imaging segmentation, supporting multiple downstream tasks. However, such models are supervised in nature, still relying on large annotated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Aishik Konwer , Zhijian Yang , Erhan Bas , Cao Xiao , Prateek Prasanna , Parminder Bhatia , Taha Kass-Hout

The Segment Anything Model (SAM) is a powerful foundation model for image segmentation, showing robust zero-shot generalization through prompt engineering. However, relying on manual prompts is impractical for real-world applications,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yi Chen , Mu-Young Son , Chuanbo Hua , Joo-Young Kim

The Segment Anything Model (SAM) emerges as a powerful vision foundation model to generate high-quality 2D segmentation results. This paper aims to generalize SAM to segment 3D objects. Rather than replicating the data acquisition and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Jiazhong Cen , Jiemin Fang , Zanwei Zhou , Chen Yang , Lingxi Xie , Xiaopeng Zhang , Wei Shen , Qi Tian

The development of high-resolution remote sensing satellites has provided great convenience for research work related to remote sensing. Segmentation and extraction of specific targets are essential tasks when facing the vast and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Jie Zhang , Xubing Yang , Rui Jiang , Wei Shao , Li Zhang

Referring Expression Comprehension and Segmentation are critical tasks for assessing the integration of language understanding and image comprehension, serving as benchmarks for Multimodal Large Language Models (MLLMs) capabilities. To…

Computation and Language · Computer Science 2026-01-21 Qihua Dong , Luis Figueroa , Handong Zhao , Kushal Kafle , Jason Kuen , Zhihong Ding , Scott Cohen , Yun Fu

In this study, we propose NOVO (NO text, Visual-Only prompts), a novel framework that bridges vision-language models (VLMs) and segmentation models through visual-only prompts. Unlike prior approaches that feed text-derived SEG token…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Kyung-Yoon Yoon , Yeong-Jun Cho

3D Referring Expression Segmentation (3D-RES) aims to segment 3D objects by correlating referring expressions with point clouds. However, traditional approaches frequently encounter issues like over-segmentation or mis-segmentation, due to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Changli Wu , Qi Chen , Jiayi Ji , Haowei Wang , Yiwei Ma , You Huang , Gen Luo , Hao Fei , Xiaoshuai Sun , Rongrong Ji

The Segment Anything Model (SAM), with its prompt-driven paradigm, exhibits strong generalization in generic segmentation tasks. However, applying SAM to remote sensing (RS) images still faces two major challenges. First, manually…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Hanbo Bi , Yulong Xu , Ya Li , Yongqiang Mao , Boyuan Tong , Chongyang Li , Chunbo Lang , Wenhui Diao , Hongqi Wang , Yingchao Feng , Xian Sun
‹ Prev 1 4 5 6 7 8 10 Next ›