English
Related papers

Related papers: Efficient Redundancy Reduction for Open-Vocabulary…

200 papers

Semantic segmentation in videos has been a focal point of recent research. However, existing models encounter challenges when faced with unfamiliar categories. To address this, we introduce the Open Vocabulary Video Semantic Segmentation…

Multimedia · Computer Science 2024-12-13 Xinhao Li , Yun Liu , Guolei Sun , Min Wu , Le Zhang , Ce Zhu

In this paper, we propose ReSeg-CLIP, a new training-free Open-Vocabulary Semantic Segmentation method for remote sensing data. To compensate for the problems of vision language models, such as CLIP in semantic segmentation caused by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Mohammadreza Heidarianbaei , Mareike Dorozynski , Hubert Kanyamahanga , Max Mehltretter , Franz Rottensteiner

Open-vocabulary semantic segmentation presents the challenge of labeling each pixel within an image based on a wide range of text descriptions. In this work, we introduce a novel cost-based approach to adapt vision-language foundation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Seokju Cho , Heeseong Shin , Sunghwan Hong , Anurag Arnab , Paul Hongsuck Seo , Seungryong Kim

Referring Expression Segmentation (RES) is a core vision-language segmentation task that enables pixel-level understanding of targets via free-form linguistic expressions, supporting critical applications such as human-robot interaction and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Yihao Wang , Jusheng Zhang , Ziyi Tang , Keze Wang , Meng Yang

We design an open-vocabulary image segmentation model to organize an image into meaningful regions indicated by arbitrary texts. Recent works (CLIP and ALIGN), despite attaining impressive open-vocabulary classification accuracy with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Golnaz Ghiasi , Xiuye Gu , Yin Cui , Tsung-Yi Lin

Pretrained vision-language models (VLMs), \eg CLIP, are increasingly used to bridge the gap between open- and close-vocabulary recognition in open-vocabulary image segmentation. As VLMs are generally pretrained with low-resolution images…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Yuanbing Zhu , Bingke Zhu , Yingying Chen , Yunfang Niu , Ming Tang , Jinqiao Wang

Change detection is a fundamental task in remote sensing, aiming to quantify the impacts of human activities and ecological dynamics on land-cover changes. Existing change detection methods are limited to predefined classes in training…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 You Su , Yonghong Song , Jingqi Chen , Zehan Wen

Training-free open-vocabulary remote sensing segmentation (OVRSS), empowered by vision-language models, has emerged as a promising paradigm for achieving category-agnostic semantic understanding in remote sensing imagery. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Wenyang Chen , Zhanxuan Hu , Yaping Zhang , Hailong Ning , Yonghang Tai

Recently, the open-vocabulary semantic segmentation problem has attracted increasing attention and the best performing methods are based on two-stream networks: one stream for proposal mask generation and the other for segment…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Cong Han , Yujie Zhong , Dengjie Li , Kai Han , Lin Ma

Event cameras, known for low-latency operation and superior performance in challenging lighting conditions, are suitable for sensitive computer vision tasks such as semantic segmentation in autonomous driving. However, challenges arise due…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Muhammad Rameez Ur Rahman , Jhony H. Giraldo , Indro Spinelli , Stéphane Lathuilière , Fabio Galasso

Current state-of-the-art open-vocabulary segmentation methods typically rely on image-mask-text triplet annotations for supervision. However, acquiring such detailed annotations is labour-intensive and poses scalability challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Zhaoqing Wang , Xiaobo Xia , Ziye Chen , Xiao He , Yandong Guo , Mingming Gong , Tongliang Liu

Open-vocabulary segmentation aims to achieve segmentation of arbitrary categories given unlimited text inputs as guidance. To achieve this, recent works have focused on developing various technical routes to exploit the potential of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yong Liu , SongLi Wu , Sule Bai , Jiahao Wang , Yitong Wang , Yansong Tang

Open-vocabulary semantic segmentation is a challenging task that requires segmenting novel object categories at inference time. Recent studies have explored vision-language pre-training to handle this task, but suffer from unrealistic…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Chaofan Ma , Yuhuan Yang , Chen Ju , Fei Zhang , Ya Zhang , Yanfeng Wang

Cloud occlusion severely degrades the semantic integrity of optical remote sensing imagery. While incorporating Synthetic Aperture Radar (SAR) provides complementary observations, achieving efficient global modeling and reliable cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Chenxing Meng , Wuzhou Quan , Yingjie Cai , Liqun Cao , Liyan Zhang , Mingqiang Wei

Open-Vocabulary Semantic Segmentation (OVSS) has advanced with recent vision-language models (VLMs), enabling segmentation beyond predefined categories through various learning schemes. Notably, training-free methods offer scalable, easily…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Chanyoung Kim , Dayun Ju , Woojung Han , Ming-Hsuan Yang , Seong Jae Hwang

Visual-textual correlations in the attention maps derived from text-to-image diffusion models are proven beneficial to dense visual prediction tasks, e.g., semantic segmentation. However, a significant challenge arises due to the input…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Jiayi Lin , Jiabo Huang , Jian Hu , Shaogang Gong

Open-vocabulary part segmentation (OVPS) is an emerging research area focused on segmenting fine-grained entities using diverse and previously unseen vocabularies. Our study highlights the inherent complexities of part segmentation due to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Jiho Choi , Seonho Lee , Seungho Lee , Minhyun Lee , Hyunjung Shim

Semantic segmentation is a crucial task in computer vision that involves segmenting images into semantically meaningful regions at the pixel level. However, existing approaches often rely on expensive human annotations as supervision for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Jun Chen , Deyao Zhu , Guocheng Qian , Bernard Ghanem , Zhicheng Yan , Chenchen Zhu , Fanyi Xiao , Mohamed Elhoseiny , Sean Chang Culatana

Open-vocabulary semantic segmentation enables models to segment objects or image regions beyond fixed class sets, offering flexibility in dynamic environments. However, existing methods often rely on single-view images and struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Thomas Campagnolo , Ezio Malis , Philippe Martinet , Gaétan Bahl

Vision-language models (VLMs) have recently expanded from static image understanding to video reasoning, but their scalability is fundamentally limited by the quadratic cost of processing dense frame sequences. Long videos often exceed the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Natan Bagrov , Eugene Khvedchenia , Borys Tymchenko , Shay Aharon , Lior Kadoch , Tomer Keren , Ofri Masad , Yonatan Geifman , Ran Zilberstein , Tuomas Rintamaki , Matthieu Le , Andrew Tao