English
Related papers

Related papers: Fully and Weakly Supervised Referring Expression S…

200 papers

Referring Audio-Visual Segmentation (Ref-AVS) aims to segment target objects in audible videos based on given reference expressions. Prior works typically rely on learning latent embeddings via multimodal fusion to prompt a tunable SAM/SAM2…

Multimedia · Computer Science 2025-08-07 Jinxing Zhou , Yanghao Zhou , Mingfei Han , Tong Wang , Xiaojun Chang , Hisham Cholakkal , Rao Muhammad Anwer

The collection of a high number of pixel-based labeled training samples for tree species identification is time consuming and costly in operational forestry applications. To address this problem, in this paper we investigate the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Steve Ahlswede , Nimisha Thekke-Madam , Christian Schulz , Birgit Kleinschmit , Begüm Demir

Accurate segmentation of Optical Coherence Tomography (OCT) images is crucial for diagnosing and monitoring retinal diseases. However, the labor-intensive nature of pixel-level annotation limits the scalability of supervised learning for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Jiaqi Yang , Nitish Mehta , Xiaoling Hu , Chao Chen , Chia-Ling Tsai

The objective of this paper is self-supervised learning of video object segmentation. We develop a unified framework which simultaneously models cross-frame dense correspondence for locally discriminative feature learning and embeds…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Liulei Li , Wenguan Wang , Tianfei Zhou , Jianwu Li , Yi Yang

Referring Expression Comprehension (REC) aims to localize an image region of a given object described by a natural-language expression. While promising performance has been demonstrated, existing REC algorithms make a strong assumption that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Heng Tao Shen , Cheng Chen , Peng Wang , Lianli Gao , Meng Wang , Jingkuan Song

Weakly-supervised instance segmentation, which could greatly save labor and time cost of pixel mask annotation, has attracted increasing attention in recent years. The commonly used pipeline firstly utilizes conventional image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Shisha Liao , Yongqing Sun , Chenqiang Gao , Pranav Shenoy K P , Song Mu , Jun Shimamura , Atsushi Sagata

Generating precise class-aware pseudo ground-truths, a.k.a, class activation maps (CAMs), is essential for weakly-supervised semantic segmentation. The original CAM method usually produces incomplete and inaccurate localization maps. To…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Jinlong Li , Zequn Jie , Xu Wang , Xiaolin Wei , Lin Ma

The task of parsing subcutaneous vessels in clinical images is often hindered by the high cost and limited availability of ground truth data, as well as the challenge of low contrast and noisy vessel appearances across different patients…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Ayaan Nooruddin Siddiqui , Mahnoor Zaidi , Ayesha Nazneen Shahbaz , Priyadarshini Chatterjee , Krishnan Menon Iyer

Referring image segmentation (RIS) requires accurate segmentation of target regions in images according to language descriptions, which is a cross-modal task integrating vision and language. Existing RIS methods typically employ large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chen Yang

The Reference Remote Sensing Image Segmentation (RRSIS) task generates segmentation masks for specified objects in images based on textual descriptions, which has attracted widespread attention and research interest. Current RRSIS methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shuyang Li , Shuang Wang , Zhuangzhuang Sun , Jing Xiao

Weakly supervised semantic segmentation produces pixel-level localization from class labels; however, a classifier trained on such labels is likely to focus on a small discriminative region of the target object. We interpret this phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Jungbeom Lee , Jooyoung Choi , Jisoo Mok , Sungroh Yoon

Referring Expression Comprehension (REC) aims to localize specified entities or regions in an image based on natural language descriptions. While existing methods handle single-entity localization, they often ignore complex inter-entity…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yizhi Hu , Zezhao Tian , Xingqun Qi , Chen Su , Bingkun Yang , Junhui Yin , Muyi Sun , Man Zhang , Zhenan Sun

Compared to conventional semantic segmentation with pixel-level supervision, Weakly Supervised Semantic Segmentation (WSSS) with image-level labels poses the challenge that it always focuses on the most discriminative regions, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Jingxuan He , Lechao Cheng , Chaowei Fang , Zunlei Feng , Tingting Mu , Mingli Song

Referring Expression Comprehension (REC) is an emerging research spot in computer vision, which refers to detecting the target region in an image given an text description. Most existing REC methods follow a multi-stage pipeline, which are…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Yiyi Zhou , Rongrong Ji , Gen Luo , Xiaoshuai Sun , Jinsong Su , Xinghao Ding , Chia-wen Lin , Qi Tian

Given an image and a natural language expression as input, the goal of referring image segmentation is to segment the foreground masks of the entities referred by the expression. Existing methods mainly focus on interactive learning between…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Jianjian Cao , Beiya Dai , Yulin Li , Xiameng Qin , Jingdong Wang

We focus on tackling weakly supervised semantic segmentation with scribble-level annotation. The regularized loss has been proven to be an effective solution for this task. However, most existing regularized losses only leverage static…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Bingfeng Zhang , Jimin Xiao , Yao Zhao

Understanding human behavior is an important problem in the pursuit of visual intelligence. A challenge in this endeavor is the extensive and costly effort required to accurately label action segments. To address this issue, we consider…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Seth Z. Zhao , Reza Ghoddoosian , Isht Dwivedi , Nakul Agarwal , Behzad Dariush

Weakly supervised semantic segmentation has witnessed great achievements with image-level labels. Several recent approaches use the CLIP model to generate pseudo labels for training an individual segmentation model, while there is no…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Bingfeng Zhang , Siyue Yu , Yunchao Wei , Yao Zhao , Jimin Xiao

Referring object detection and referring image segmentation are important tasks that require joint understanding of visual information and natural language. Yet there has been evidence that current benchmark datasets suffer from bias, and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Runtao Liu , Chenxi Liu , Yutong Bai , Alan Yuille

Weakly supervised instance segmentation reduces the cost of annotations required to train models. However, existing approaches which rely only on image-level class labels predominantly suffer from errors due to (a) partial segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Qing Liu , Vignesh Ramanathan , Dhruv Mahajan , Alan Yuille , Zhenheng Yang