English
Related papers

Related papers: Decouple and Rectify: Semantics-Preserving Structu…

200 papers

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

Open-Vocabulary Part Segmentation (OVPS) is an emerging field for recognizing fine-grained parts in unseen categories. We identify two primary challenges in OVPS: (1) the difficulty in aligning part-level image-text correspondence, and (2)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jiho Choi , Seonho Lee , Minhyun Lee , Seungho Lee , Hyunjung Shim

Semantic segmentation is a critical technique for effective scene understanding. Traditional RGB-T semantic segmentation models often struggle to generalize across diverse scenarios due to their reliance on pretrained models and predefined…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Meng Yu , Luojie Yang , Xunjie He , Yi Yang , Yufeng Yue

As a common method in the field of computer vision, spatial attention mechanism has been widely used in semantic segmentation of remote sensing images due to its outstanding long-range dependency modeling capability. However, remote sensing…

Image and Video Processing · Electrical Eng. & Systems 2025-01-24 Xiaowen Ma , Rongrong Lian , Zhenkai Wu , Renxiang Guan , Tingfeng Hong , Mengjiao Zhao , Mengting Ma , Jiangtao Nie , Zhenhong Du , Siyang Song , Wei Zhang

Class-Incremental Learning (CIL) enables models to continuously integrate new knowledge while mitigating catastrophic forgetting. Driven by the remarkable generalization of CLIP, leveraging pre-trained vision-language models has become a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Hao Sun , Zi-Jun Ding , Da-Wei Zhou

Open-vocabulary semantic segmentation enables models to segment objects or image regions beyond fixed class sets, offering flexibility in dynamic environments. However, existing methods often rely on single-view images and struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Thomas Campagnolo , Ezio Malis , Philippe Martinet , Gaétan Bahl

Image-text contrastive models like CLIP have wide applications in zero-shot classification, image-text retrieval, and transfer learning. However, they often struggle on compositional visio-linguistic tasks (e.g., attribute-binding or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Samyadeep Basu , Shell Xu Hu , Maziar Sanjabi , Daniela Massiceti , Soheil Feizi

Multi-label recognition with partial labels (MLR-PL), in which only some labels are known while others are unknown for each image, is a practical task in computer vision, since collecting large-scale and complete multi-label datasets is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Haoxian Ruan , Zhihua Xu , Zhijing Yang , Yongyi Lu , Jinghui Qin , Tianshui Chen

Open-Vocabulary Segmentation (OVS) has drawn increasing attention for its capacity to generalize segmentation beyond predefined categories. However, existing methods typically predict segmentation masks with simple forward inference,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Zongyan Han , Jiale Cao , Shuo Chen , Tong Wang , Jorma Laaksonen , Rao Muhammad Anwer

Large Vision--Language Models (LVLMs) hold great promise for advancing optical remote sensing (RS) analysis, yet existing reasoning segmentation frameworks couple linguistic reasoning and pixel prediction through end-to-end supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xu Zhang , Junyao Ge , Yang Zheng , Kaitai Guo , Jimin Liang

Weakly supervised semantic segmentation (WSSS) with image-level labels is a challenging task. Mainstream approaches follow a multi-stage framework and suffer from high training costs. In this paper, we explore the potential of Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yuqi Lin , Minghao Chen , Wenxiao Wang , Boxi Wu , Ke Li , Binbin Lin , Haifeng Liu , Xiaofei He

Ambiguity poses persistent challenges in natural language understanding for large language models (LLMs). To better understand how lexical ambiguity can be resolved through the visual domain, we develop an interpretable Visual Word Sense…

Computation and Language · Computer Science 2026-02-09 Shamik Bhattacharya , Daniel Perkins , Yaren Dogan , Vineeth Konjeti , Sudarshan Srinivasan , Edmon Begoli

Latent image representations arising from vision-language models have proved immensely useful for a variety of downstream tasks. However, their utility is limited by their entanglement with respect to different visual attributes. For…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 James Oldfield , Christos Tzelepis , Yannis Panagakis , Mihalis A. Nicolaou , Ioannis Patras

Most existing methods for training-free open-vocabulary semantic segmentation are based on CLIP. While these approaches have made progress, they often face challenges in precise localization or require complex pipelines to combine separate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Kaiyu Li , Shengqi Zhang , Yujie Wang , Yupeng Deng , Zhi Wang , Deyu Meng , Xiangyong Cao

Vision foundation models have shown great promise for open-set 3D object retrieval (3DOR) through efficient adaptation to multi-view images. Leveraging semantically aligned latent space, previous work typically adapts the CLIP encoder to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xinwei He , Yansong Zheng , Qianru Han , Zhichuan Wang , Yuxuan Cai , Yang Zhou , Jingbo Xia , Yulong Wang , Jinhai Xiang , Xiang Bai

Medical image segmentation of anatomical structures and pathology is crucial in modern clinical diagnosis, disease study, and treatment planning. To date, great progress has been made in deep learning-based segmentation techniques, but most…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao

Diabetic retinopathy (DR) is a leading cause of preventable blindness worldwide, demanding accurate automated diagnostic systems. While general-domain vision-language models like Contrastive Language-Image Pre-Training (CLIP) perform well…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Argha Kamal Samanta , Harshika Goyal , Vasudha Joshi , Tushar Mungle , Pabitra Mitra

Segmentation of anatomical structures and pathological regions in medical images is essential for modern clinical diagnosis, disease research, and treatment planning. While significant advancements have been made in deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao

3D indoor layout synthesis is crucial for creating virtual environments. Traditional methods struggle with generalization due to fixed datasets. While recent LLM and VLM-based approaches offer improved semantic richness, they often lack…

Robotics · Computer Science 2025-10-03 Jialin Gao , Donghao Zhou , Mingjian Liang , Lihao Liu , Chi-Wing Fu , Xiaowei Hu , Pheng-Ann Heng

Recently, open-vocabulary learning has emerged to accomplish segmentation for arbitrary categories of text-based descriptions, which popularizes the segmentation system to more general-purpose application scenarios. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Jie Qin , Jie Wu , Pengxiang Yan , Ming Li , Ren Yuxi , Xuefeng Xiao , Yitong Wang , Rui Wang , Shilei Wen , Xin Pan , Xingang Wang