English
Related papers

Related papers: dinov3.seg: Open-Vocabulary Semantic Segmentation …

200 papers

The remote sensing (RS) domain suffers from a lack of densely labeled datasets, which are costly to obtain. Thus, models that can segment RS imagery well without supervised fine-tuning are valuable, but existing solutions fall behind…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Ryan Faulkenberry , Saurabh Prasad

Remote sensing image plays an irreplaceable role in fields such as agriculture, water resources, military, and disaster relief. Pixel-level interpretation is a critical aspect of remote sensing image applications; however, a prevalent…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kaiyu Li , Ruixun Liu , Xiangyong Cao , Xueru Bai , Feng Zhou , Deyu Meng , Zhi Wang

Open-vocabulary segmentation aims to achieve segmentation of arbitrary categories given unlimited text inputs as guidance. To achieve this, recent works have focused on developing various technical routes to exploit the potential of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yong Liu , SongLi Wu , Sule Bai , Jiahao Wang , Yitong Wang , Yansong Tang

We present Seg-TTO, a novel framework for zero-shot, open-vocabulary semantic segmentation (OVSS), designed to excel in specialized domain tasks. While current open-vocabulary approaches show impressive performance on standard segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ulindu De Silva , Didula Samaraweera , Sasini Wanigathunga , Kavindu Kariyawasam , Kanchana Ranasinghe , Muzammal Naseer , Ranga Rodrigo

From image-text pairs, large-scale vision-language models (VLMs) learn to implicitly associate image regions with words, which prove effective for tasks like visual question answering. However, leveraging the learned association for…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jiayun Luo , Siddhesh Khandelwal , Leonid Sigal , Boyang Li

The recent years have witnessed the remarkable development for open-vocabulary semantic segmentation (OVSS) using visual-language foundation models, yet still suffer from following fundamental challenges: (1) insufficient cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jing Wang , Huimin Shi , Quan Zhou , Qibo Liu , Suofei Zhang , Huimin Lu

Event cameras, known for low-latency operation and superior performance in challenging lighting conditions, are suitable for sensitive computer vision tasks such as semantic segmentation in autonomous driving. However, challenges arise due…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Muhammad Rameez Ur Rahman , Jhony H. Giraldo , Indro Spinelli , Stéphane Lathuilière , Fabio Galasso

The global rise in the number of people with physical disabilities, in part due to improvements in post-trauma survivorship and longevity, has amplified the demand for advanced assistive technologies to improve mobility and independence.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yifan Xu , Vineet Kamat , Carol Menassa

Open-Vocabulary Remote Sensing Image Segmentation (OVRSIS), an emerging task that adapts Open-Vocabulary Segmentation (OVS) to the remote sensing (RS) domain, remains underexplored due to the absence of a unified evaluation benchmark and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Bingyu Li , Haocheng Dong , Da Zhang , Zhiyuan Zhao , Junyu Gao , Xuelong Li

To bridge the gap between supervised semantic segmentation and real-world applications that acquires one model to recognize arbitrary new concepts, recent zero-shot segmentation attracts a lot of attention by exploring the relationships…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Quande Liu , Youpeng Wen , Jianhua Han , Chunjing Xu , Hang Xu , Xiaodan Liang

Open-vocabulary scene understanding using 3D Gaussian (3DGS) representations has garnered considerable attention. However, existing methods mostly lift knowledge from large 2D vision models into 3DGS on a scene-by-scene basis, restricting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Runnan Chen , Xiangyu Sun , Zhaoqing Wang , Youquan Liu , Jiepeng Wang , Lingdong Kong , Jiankang Deng , Mingming Gong , Liang Pan , Wenping Wang , Tongliang Liu

Existing studies typically investigate domain shift and category shift as independent problems, however, in real-world scenarios, the two types of shifts often occur simultaneously and interact, leading to significant degradation in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yupeng Zhang , Ruize Han , Fangnan Zhou , Wei Feng , Liang Wan

Few-shot semantic segmentation (FSS) aims to enable models to segment novel/unseen object classes using only a limited number of labeled examples. However, current FSS methods frequently struggle with generalization due to incomplete and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Amin Karimi , Charalambos Poullis

Recently, deep learning based methods have revolutionized remote sensing image segmentation. However, these methods usually rely on a pre-defined semantic class set, thus needing additional image annotation and model training when adapting…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Chengyang Ye , Yunzhi Zhuge , Pingping Zhang

Recently, Vision-Language Models (VLMs) have advanced segmentation techniques by shifting from the traditional segmentation of a closed-set of predefined object classes to open-vocabulary segmentation (OVS), allowing users to segment novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Gonca Yilmaz , Songyou Peng , Marc Pollefeys , Francis Engelmann , Hermann Blum

Training-free open-vocabulary remote sensing segmentation (OVRSS), empowered by vision-language models, has emerged as a promising paradigm for achieving category-agnostic semantic understanding in remote sensing imagery. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Wenyang Chen , Zhanxuan Hu , Yaping Zhang , Hailong Ning , Yonghang Tai

Open-Vocabulary Part Segmentation (OVPS) is an emerging field for recognizing fine-grained parts in unseen categories. We identify two primary challenges in OVPS: (1) the difficulty in aligning part-level image-text correspondence, and (2)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jiho Choi , Seonho Lee , Minhyun Lee , Seungho Lee , Hyunjung Shim

3D semantic segmentation provides high-level scene understanding for applications in robotics, autonomous systems, \textit{etc}. Traditional methods adapt exclusively to either task-specific goals (open-vocabulary segmentation) or scene…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Doriand Petit , Steve Bourgeois , Vincent Gay-Bellile , Florian Chabot , Loïc Barthe

Open-Vocabulary Segmentation (OVS) aims to segment classes that are not present in the training dataset. However, most existing studies assume that the training data is fixed in advance, overlooking more practical scenarios where new…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Dongjun Hwang , Yejin Kim , Minyoung Lee , Seong Joon Oh , Junsuk Choe

Visual-textual correlations in the attention maps derived from text-to-image diffusion models are proven beneficial to dense visual prediction tasks, e.g., semantic segmentation. However, a significant challenge arises due to the input…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Jiayi Lin , Jiabo Huang , Jian Hu , Shaogang Gong