English
Related papers

Related papers: DPSeg: Dual-Prompt Cost Volume Learning for Open-V…

200 papers

Semantic segmentation is a core computer vision problem, but the high costs of data annotation have hindered its wide application. Weakly-Supervised Semantic Segmentation (WSSS) offers a cost-efficient workaround to extensive labeling in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Elham Ravanbakhsh , Cheng Niu , Yongqing Liang , J. Ramanujam , Xin Li

Open-vocabulary part segmentation (OVPS) is an emerging research area focused on segmenting fine-grained entities using diverse and previously unseen vocabularies. Our study highlights the inherent complexities of part segmentation due to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Jiho Choi , Seonho Lee , Seungho Lee , Minhyun Lee , Hyunjung Shim

This paper studies open-vocabulary segmentation (OVS) through calibrating in-vocabulary and domain-biased embedding space with generalized contextual prior of CLIP. As the core of open-vocabulary understanding, alignment of visual content…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yong Liu , Sule Bai , Guanbin Li , Yitong Wang , Yansong Tang

Image semantic segmentation is more and more being of interest for computer vision and machine learning researchers. Many applications on the rise need accurate and efficient segmentation mechanisms: autonomous driving, indoor navigation,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Alberto Garcia-Garcia , Sergio Orts-Escolano , Sergiu Oprea , Victor Villena-Martinez , Jose Garcia-Rodriguez

Segment Anything Models (SAMs) like SEEM and SAM have demonstrated great potential in learning to segment anything. The core design of SAMs lies with Promptable Segmentation, which takes a handcrafted prompt as input and returns the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jiaxing Huang , Kai Jiang , Jingyi Zhang , Han Qiu , Lewei Lu , Shijian Lu , Eric Xing

Open-vocabulary semantic segmentation enables models to segment objects or image regions beyond fixed class sets, offering flexibility in dynamic environments. However, existing methods often rely on single-view images and struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Thomas Campagnolo , Ezio Malis , Philippe Martinet , Gaétan Bahl

Semantic segmentation takes pivotal roles in various applications such as autonomous driving and medical image analysis. When deploying segmentation models in practice, it is critical to test their behaviors in varied and complex scenes in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zijin Yin , Bing Li , Kongming Liang , Hao Sun , Zhongjiang He , Zhanyu Ma , Jun Guo

In this work, we address the task of few-shot part segmentation, which aims to segment the different parts of an unseen object using very few labeled examples. It is found that leveraging the textual space of a powerful pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Mengya Han , Heliang Zheng , Chaoyue Wang , Yong Luo , Han Hu , Jing Zhang , Yonggang Wen

Diffusion models are primarily trained for image synthesis, yet their denoising trajectories encode rich, spatially aligned visual priors. In this paper, we demonstrate that these priors can be utilized for text-conditioned semantic and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Haoxiao Wang , Antao Xiang , Haiyang Sun , Peilin Sun , Changhao Pan , Yifu Chen , Minjie Hong , Weijie Wang , Shuang Chen , Yue Chen , Zhou Zhao

Widely adopted medical image segmentation methods, although efficient, are primarily deterministic and remain poorly amenable to natural language prompts. Thus, they lack the capability to estimate multiple proposals, human interaction, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yuan Lin , Murong Xu , Marc Hölle , Chinmay Prabhakar , Andreas Maier , Vasileios Belagiannis , Bjoern Menze , Suprosanna Shit

Scaling up the vocabulary of semantic segmentation models is extremely challenging because annotating large-scale mask labels is labour-intensive and time-consuming. Recently, language-guided segmentation models have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Haojun Yu , Di Dai , Ziwei Zhao , Di He , Han Hu , Liwei Wang

Accurate segmentation is essential for echocardiography-based assessment of cardiovascular diseases (CVDs). However, the variability among sonographers and the inherent challenges of ultrasound images hinder precise segmentation. By…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Rabin Adhikari , Manish Dhakal , Safal Thapaliya , Kanchan Poudel , Prasiddha Bhandari , Bishesh Khanal

Text-to-image diffusion models excel at generating high-quality images from natural language descriptions but often fail to preserve subject consistency across multiple outputs, limiting their use in visual storytelling. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Shangxun Li , Youngjung Uh

The spatial semantic segmentation task focuses on separating and classifying sound objects from multichannel signals. To achieve two different goals, conventional methods fine-tune a large classification model cascaded with the separation…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-22 Younghoo Kwon , Jung-Woo Choi

Open-Vocabulary Segmentation (OVS) has drawn increasing attention for its capacity to generalize segmentation beyond predefined categories. However, existing methods typically predict segmentation masks with simple forward inference,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Zongyan Han , Jiale Cao , Shuo Chen , Tong Wang , Jorma Laaksonen , Rao Muhammad Anwer

Open-vocabulary segmentation models such as SAM3 perform well across broad categories via text prompting, yet degrade when target classes are visually underrepresented in pretraining or depart from canonical depictions-limitations text…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Abderrahmene Boudiaf , Irfan Hussain , Sajid Javed

Promptable foundation models such as the Segment Anything Model (SAM) produce high-quality masks but remain semantically blind, relying on external prompts to specify categories. Existing vision-language approaches address this limitation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shayan Jalilian , Abdul Bais

Representation of semantic context and local details is the essential issue for building modern semantic segmentation models. However, the interrelationship between semantic context and local details is not well explored in previous works.…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Chen Shi , Xiangtai Li , Yanran Wu , Yunhai Tong , Yi Xu

Open-vocabulary semantic segmentation (OVSS) aims to segment and recognize objects universally. Trained on extensive high-quality segmentation data, the segment anything model (SAM) has demonstrated remarkable universal segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Lin Chen , Yingjian Zhu , Qi Yang , Xin Niu , Kun Ding , Shiming Xiang

Large-scale pre-trained image-text models exhibit robust multimodal representations, yet applying the Contrastive Language-Image Pre-training (CLIP) model to audio-visual localization remains challenging. Replacing the classification token…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Khanh Binh Nguyen , Chae Jung Park