English
Related papers

Related papers: Open-world Semantic Segmentation via Contrasting a…

200 papers

Semantic segmentation in videos has been a focal point of recent research. However, existing models encounter challenges when faced with unfamiliar categories. To address this, we introduce the Open Vocabulary Video Semantic Segmentation…

Multimedia · Computer Science 2024-12-13 Xinhao Li , Yun Liu , Guolei Sun , Min Wu , Le Zhang , Ce Zhu

Zero-shot learning has been actively studied for image classification task to relieve the burden of annotating image labels. Interestingly, semantic segmentation task requires more labor-intensive pixel-wise annotation, but zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Zhangxuan Gu , Siyuan Zhou , Li Niu , Zihan Zhao , Liqing Zhang

Recent advances in visual-language models have shown remarkable zero-shot text-image matching ability that is transferable to downstream tasks such as object detection and segmentation. Adapting these models for object counting, however,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Ruixiang Jiang , Lingbo Liu , Changwen Chen

Semantic segmentation of multi-modal remote sensing imagery plays a pivotal role in land use/land cover (LULC) mapping, environmental monitoring, and precision earth observation. Current multi-modal approaches mainly focus on integrating…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jinkun Dai , Yuanxin Ye , Peng Tang , Tengfeng Tang , Xianping Ma , Jing Xiao , Mi Wang

Semantic segmentation is an important and popular research area in computer vision that focuses on classifying pixels in an image based on their semantics. However, supervised deep learning requires large amounts of data to train models and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Lingyan Ran , Yali Li , Guoqiang Liang , Yanning Zhang

Visual transfer learning for unseen categories presents an active research topic yet a challenging task, due to the inherent conflict between preserving category-specific representations and acquiring transferable knowledge. Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Xiao Shi , Yangjun Ou , Zhenzhong Chen

Semantic segmentation is fundamental to vision systems requiring pixel-level scene understanding, yet deploying it on resource-constrained devices demands efficient architectures. Although existing methods achieve real-time inference…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Shi-Chen Zhang , Yunheng Li , Yu-Huan Wu , Qibin Hou , Ming-Ming Cheng

Using deep learning, we now have the ability to create exceptionally good semantic segmentation systems; however, collecting the prerequisite pixel-wise annotations for training images remains expensive and time-consuming. Therefore, it…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Aneesh Rangnekar , Christopher Kanan , Matthew Hoffman

To alleviate the expensive human labeling, semi-supervised semantic segmentation employs a few labeled images and an abundant of unlabeled images to predict the pixel-level label map with the same size. Previous methods often adopt…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Ping Li , Junjie Chen , Li Yuan , Xianghua Xu , Mingli Song

Open-world point cloud semantic segmentation (OW-Seg) aims to predict point labels of both base and novel classes in real-world scenarios. However, existing methods rely on resource-intensive offline incremental learning or densely…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Peng Zhang , Songru Yang , Jinsheng Sun , Weiqing Li , Zhiyong Su

Weakly supervised segmentation requires assigning a label to every pixel based on training instances with partial annotations such as image-level tags, object bounding boxes, labeled points and scribbles. This task is challenging, as coarse…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Tsung-Wei Ke , Jyh-Jing Hwang , Stella X. Yu

Visual grounding localizes regions (boxes or segments) in the image corresponding to given referring expressions. In this work we address image segmentation from referring expressions, a problem that has so far only been addressed in a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Robin Strudel , Ivan Laptev , Cordelia Schmid

This paper presents a semi-supervised learning framework for a customized semantic segmentation task using multiview image streams. A key challenge of the customized task lies in the limited accessibility of the labeled data due to the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Yuan Yao , Hyun Soo Park

Recently, the open-vocabulary semantic segmentation problem has attracted increasing attention and the best performing methods are based on two-stream networks: one stream for proposal mask generation and the other for segment…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Cong Han , Yujie Zhong , Dengjie Li , Kai Han , Lin Ma

Semantic image editing requires inpainting pixels following a semantic map. It is a challenging task since this inpainting requires both harmony with the context and strict compliance with the semantic maps. The majority of the previous…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Hakan Sivuk , Aysegul Dundar

Segmentation localizes objects in an image on a fine-grained per-pixel scale. Segmentation benefits by humans-in-the-loop to provide additional input of objects to segment using a combination of foreground or background clicks. Tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Nikolai Warner , Meera Hahn , Jonathan Huang , Irfan Essa , Vighnesh Birodkar

Building robust and generic object detection frameworks requires scaling to larger label spaces and bigger training datasets. However, it is prohibitively costly to acquire annotations for thousands of categories at a large scale. We…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Shiyu Zhao , Zhixing Zhang , Samuel Schulter , Long Zhao , Vijay Kumar B. G , Anastasis Stathopoulos , Manmohan Chandraker , Dimitris Metaxas

Accurately recognizing a revisited place is crucial for embodied agents to localize and navigate. This requires visual representations to be distinct, despite strong variations in camera viewpoint and scene appearance. Existing visual place…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Kartik Garg , Sai Shubodh Puligilla , Shishir Kolathaya , Madhava Krishna , Sourav Garg

Open-vocabulary image segmentation aims to partition an image into semantic regions according to arbitrary text descriptions. However, complex visual scenes can be naturally decomposed into simpler parts and abstracted at multiple levels of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Xudong Wang , Shufan Li , Konstantinos Kallidromitis , Yusuke Kato , Kazuki Kozuka , Trevor Darrell

Existing open-world universal segmentation approaches usually leverage CLIP and pre-computed proposal masks to treat open-world segmentation tasks as proposal classification. However, 1) these works cannot handle universal segmentation in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Bowen Dong , Jiaxi Gu , Jianhua Han , Hang Xu , Wangmeng Zuo