English
Related papers

Related papers: Referring Video Object Segmentation with Cross-Mod…

200 papers

Referring Expression Segmentation (RES) is a widely explored multi-modal task, which endeavors to segment the pre-existing object within a single image with a given linguistic expression. However, in broader real-world scenarios, it is not…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Yixuan Wu , Zhao Zhang , Xie Chi , Feng Zhu , Rui Zhao

Reference Audio-Visual Segmentation (Ref-AVS) aims to segment objects in audible videos based on multimodal cues in reference expressions. Previous methods overlook the explicit recognition of expression difficulty and dominant modality in…

Multimedia · Computer Science 2026-03-31 Yuan Zhao , Zhenqi Jia , Yongqiang Zhang

Referring multi-object tracking (RMOT) is an emerging cross-modal task that aims to localize an arbitrary number of targets based on a language expression and continuously track them in a video. This intricate task involves reasoning on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Wenjun Huang , Yang Ni , Hanning Chen , Yirui He , Ian Bryant , Yezi Liu , Mohsen Imani

Audio-visual segmentation (AVS) is an emerging task that aims to accurately segment sounding objects based on audio-visual cues. The success of AVS learning systems depends on the effectiveness of cross-modal interaction. Such a requirement…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yuanhong Chen , Chong Wang , Yuyuan Liu , Hu Wang , Gustavo Carneiro

Video Object Segmentation, and video processing in general, has been historically dominated by methods that rely on the temporal consistency and redundancy in consecutive video frames. When the temporal smoothness is suddenly broken, such…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Kevis-Kokitsi Maninis , Sergi Caelles , Yuhua Chen , Jordi Pont-Tuset , Laura Leal-Taixé , Daniel Cremers , Luc Van Gool

3D referring segmentation is an emerging and challenging vision-language task that aims to segment the object described by a natural language expression in a point cloud scene. The key challenge behind this task is vision-language feature…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Shuting He , Henghui Ding

We introduce ReConvNet, a recurrent convolutional architecture for semi-supervised video object segmentation that is able to fast adapt its features to focus on any specific object of interest at inference time. Generalization to new…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Francesco Lattari , Marco Ciccone , Matteo Matteucci , Jonathan Masci , Francesco Visin

Open-vocabulary segmentation (OVS) extends the zero-shot recognition capabilities of vision-language models (VLMs) to pixel-level prediction, enabling segmentation of arbitrary categories specified by text prompts. Despite recent progress,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Tilemachos Aravanis , Vladan Stojnić , Bill Psomas , Nikos Komodakis , Giorgos Tolias

The advancement of computer vision has pushed visual analysis tasks from still images to the video domain. In recent years, video instance segmentation, which aims to track and segment multiple objects in video frames, has drawn much…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Yiming Cui , Cheng Han , Dongfang Liu

Audio-Visual Segmentation (AVS) aims to precisely outline audible objects in a visual scene at the pixel level. Existing AVS methods require fine-grained annotations of audio-mask pairs in supervised learning fashion. This limits their…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Swapnil Bhosale , Haosen Yang , Diptesh Kanojia , Xiatian Zhu

Semi-supervised video object segmentation (VOS) aims to track the designated objects present in the initial frame of a video at the pixel level. To fully exploit the appearance information of an object, pixel-level feature matching is…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Suhwan Cho , Heansung Lee , Minjung Kim , Sungjun Jang , Sangyoun Lee

As a milestone for video object segmentation, one-shot video object segmentation (OSVOS) has achieved a large margin compared to the conventional optical-flow based methods regarding to the segmentation accuracy. Its excellent performance…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Yu Liu , Yutong Dai , Anh-Dzung Doan , Lingqiao Liu , Ian Reid

Video segmentation requires consistently segmenting and tracking objects over time. Due to the quadratic dependency on input size, directly applying self-attention to video segmentation with high-resolution input features poses significant…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Ju He , Qihang Yu , Inkyu Shin , Xueqing Deng , Alan Yuille , Xiaohui Shen , Liang-Chieh Chen

We propose Segment Concept (SeC), a concept-driven video object segmentation (VOS) framework that shifts from conventional feature matching to the progressive construction and utilization of high-level, object-centric representations. SeC…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhixiong Zhang , Shuangrui Ding , Xiaoyi Dong , Songxin He , Jianfan Lin , Junsong Tang , Yuhang Zang , Yuhang Cao , Dahua Lin , Jiaqi Wang

We propose a novel self-supervised Video Object Segmentation (VOS) approach that strives to achieve better object-background discriminability for accurate object segmentation. Distinct from previous self-supervised VOS methods, our approach…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Jyoti Kini , Fahad Shahbaz Khan , Salman Khan , Mubarak Shah

Many of the recent successful methods for video object segmentation (VOS) are overly complicated, heavily rely on fine-tuning on the first frame, and/or are slow, and are hence of limited practical use. In this work, we propose FEELVOS as a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Paul Voigtlaender , Yuning Chai , Florian Schroff , Hartwig Adam , Bastian Leibe , Liang-Chieh Chen

In this work, we present a new computer vision task named video object of interest segmentation (VOIS). Given a video and a target image of interest, our objective is to simultaneously segment and track all objects in the video that are…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Siyuan Zhou , Chunru Zhan , Biao Wang , Tiezheng Ge , Yuning Jiang , Li Niu

Referring Image Segmentation (RIS) is a challenging task that requires an algorithm to segment objects referred by free-form language expressions. Despite significant progress in recent years, most state-of-the-art (SOTA) methods still…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yong Xien Chng , Henry Zheng , Yizeng Han , Xuchong Qiu , Gao Huang

This report presents an overview of the 7th Large-scale Video Object Segmentation (LSVOS) Challenge held in conjunction with ICCV 2025. Besides the two traditional tracks of LSVOS that jointly target robustness in realistic video scenarios:…

Amodal perception requires inferring the full shape of an object that is partially occluded. This task is particularly challenging on two levels: (1) it requires more information than what is contained in the instant retina or imaging…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Jian Yao , Yuxin Hong , Chiyu Wang , Tianjun Xiao , Tong He , Francesco Locatello , David Wipf , Yanwei Fu , Zheng Zhang