English
Related papers

Related papers: SegRAG: Training-Free Retrieval-Augmented Semantic…

200 papers

Previous work has reported that vision foundation models show promising zero-shot performance in eye image segmentation. Here we examine whether the latest iteration of the Segment Anything Model, SAM3, offers better eye image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Diederick C. Niehorster , Marcus Nyström

Open-Vocabulary Semantic Segmentation (OVSS) assigns pixel-level labels from an open set of text-defined categories, demanding reliable generalization to unseen classes at inference. Although modern vision-language models (VLMs) support…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Saikat Dutta , Biplab Banerjee , Hamid Rezatofighi

Promptable foundation models such as the Segment Anything Model (SAM) produce high-quality masks but remain semantically blind, relying on external prompts to specify categories. Existing vision-language approaches address this limitation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shayan Jalilian , Abdul Bais

Segment Anything Models (SAMs) like SEEM and SAM have demonstrated great potential in learning to segment anything. The core design of SAMs lies with Promptable Segmentation, which takes a handcrafted prompt as input and returns the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jiaxing Huang , Kai Jiang , Jingyi Zhang , Han Qiu , Lewei Lu , Shijian Lu , Eric Xing

Open world image segmentation aims to achieve precise segmentation and semantic understanding of targets within images by addressing the infinitely open set of object categories encountered in the real world. However, traditional closed-set…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Danyang Li , Tianhao Wu , Bin Li , Zhenyuan Chen , Yang Zhang , Yuxuan Li , Ming-Ming Cheng , Xiang Li

Segment Anything Model 3 (SAM3) advances open-vocabulary segmentation through promptable concept segmentation, enabling users to segment all instances associated with a given concept using short noun-phrase (NP) prompts. While effective for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Jingjing Li , Yue Feng , Yuchen Guo , Jincai Huang , Wei Ji , Qi Bi , Yongri Piao , Miao Zhang , Xiaoqi Zhao , Qiang Chen , Shihao Zou , Huchuan Lu , Li Cheng

Segment Anything Model (SAM) has attracted widespread attention for its superior interactive segmentation capabilities with visual prompts while lacking further exploration of text prompts. In this paper, we empirically investigate what…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuxuan Zhang , Tianheng Cheng , Lianghui Zhu , Rui Hu , Lei Liu , Heng Liu , Longjin Ran , Xiaoxin Chen , Wenyu Liu , Xinggang Wang

Image-text models excel at image-level tasks but struggle with detailed visual understanding. While these models provide strong visual-language alignment, segmentation models like SAM2 offer precise spatial boundaries for objects. To this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Yao Xiao , Qiqian Fu , Heyi Tao , Yuqun Wu , Zhen Zhu , Derek Hoiem

Semantic segmentation is an important task for numerous applications but it is still quite challenging to achieve advanced performance with limited computational costs. In this paper, we present CGRSeg, an efficient yet competitive…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Zhenliang Ni , Xinghao Chen , Yingjie Zhai , Yehui Tang , Yunhe Wang

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

Weakly supervised semantic segmentation aims to achieve pixel-level predictions using image-level labels. Existing methods typically entangle semantic recognition and object localization, which often leads models to focus exclusively on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Qingze He , Fagui Liu , Dengke Zhang , Qingmao Wei , Quan Tang

Despite significant progress in 3D point cloud segmentation, existing methods primarily address specific tasks and depend on explicit instructions to identify targets, lacking the capability to infer and understand implicit user intentions…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Shuting He , Henghui Ding , Xudong Jiang , Bihan Wen

The Segment Anything Model (SAM) achieves remarkable promptable segmentation given high-quality prompts which, however, often require good skills to specify. To make SAM robust to casual prompts, this paper presents the first comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Qi Fan , Xin Tao , Lei Ke , Mingqiao Ye , Yuan Zhang , Pengfei Wan , Zhongyuan Wang , Yu-Wing Tai , Chi-Keung Tang

Recently, learning open-vocabulary semantic segmentation from text supervision has achieved promising downstream performance. Nevertheless, current approaches encounter an alignment granularity gap owing to the absence of dense annotations,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Yajie Liu , Pu Ge , Qingjie Liu , Di Huang

Weakly supervised landslide extraction aims to identify landslide regions from remote sensing data using models trained with weak labels, particularly image-level labels. However, it is often challenged by the imprecise boundaries of the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Jian Wang , Xiaokang Zhang , Xianping Ma , Weikang Yu , Pedram Ghamisi

Vision-language segmentation models have recently achieved strong performance by leveraging high-level semantic object categories expressed in natural language. However, this semantic dependence limits their ability to reason about…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Corentin Seutin , Mohamed Amine Ettaki , Michaël Clément , Pierrick Coupé , Rémi Giraud

Professional domain knowledge underpins human civilization, serving as both the basis for industry entry and the core of complex decision-making and problem-solving. However, existing large language models often suffer from opaque inference…

Computation and Language · Computer Science 2026-04-30 Xudong Wang , Zilong Wang , Zhaoyan Ming

Although new vision foundation models such as Segment Anything Model 2 (SAM2) have significantly enhanced zero-shot image segmentation capabilities, reliance on human-provided prompts poses significant challenges in adapting SAM2 to medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yang Xing , Jiong Wu , Yuheng Bu , Kuang Gong

Language-guided segmentation transcends the scope limitations of traditional semantic segmentation, enabling models to segment arbitrary target regions based on natural language instructions. Existing approaches typically adopt a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Chao Hao , Jun Xu , Ji Du , Shuo Ye , Ziyue Qiao , Xiaodong Cun , Guangcong Wang , Xubin Zheng , Zitong Yu