English
Related papers

Related papers: InterRVOS: Interaction-aware Referring Video Objec…

200 papers

Referring Video Object Segmentation (RVOS) aims to segment the object referred to by the query sentence throughout the entire video. Most existing methods require end-to-end training with dense mask annotations, which could be…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Ci-Siang Lin , I-Jieh Liu , Min-Hung Chen , Chien-Yi Wang , Sifei Liu , Yu-Chiang Frank Wang

Remote sensing video referring object segmentation (RS-RVOS) is challenged by weak target saliency and severe visual information truncation in dynamic scenes, making it extremely difficult to maintain discriminative target representations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 H. Jiang , Y. Sun , Z. Dong , T. Liu , Y. Gu

The reference-based object segmentation tasks, namely referring image segmentation (RIS), few-shot image segmentation (FSS), referring video object segmentation (RVOS), and video object segmentation (VOS), aim to segment a specific object…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Jiannan Wu , Yi Jiang , Bin Yan , Huchuan Lu , Zehuan Yuan , Ping Luo

Interactive Video Object Segmentation (iVOS) is a challenging task that requires real-time human-computer interaction. To improve the user experience, it is important to consider the user's input habits, segmentation quality, running time…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Kexin Li , Tao Jiang , Zongxin Yang , Yi Yang , Yueting Zhuang , Jun Xiao

Referring Video Object Segmentation (RVOS) aims to segment and track objects in videos based on natural language expressions, requiring precise alignment between visual content and textual queries. However, existing methods often suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Seunghun Lee , Jiwan Seo , Jeonghoon Kim , Sungho Moon , Siwon Kim , Haeun Yun , Hyogyeong Jeon , Wonhyeok Choi , Jaehoon Jeong , Zane Durante , Sang Hyun Park , Sunghoon Im

Amodal perception requires inferring the full shape of an object that is partially occluded. This task is particularly challenging on two levels: (1) it requires more information than what is contained in the instant retina or imaging…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Jian Yao , Yuxin Hong , Chiyu Wang , Tianjun Xiao , Tong He , Francesco Locatello , David Wipf , Yanwei Fu , Zheng Zhang

This paper addresses the task of unsupervised video multi-object segmentation. Current approaches follow a two-stage paradigm: 1) detect object proposals using pre-trained Mask R-CNN, and 2) conduct generic feature matching for temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Tianfei Zhou , Jianwu Li , Xueyi Li , Ling Shao

Referring video object segmentation aims to segment the object referred by a given language expression. Existing works typically require compressed video bitstream to be decoded to RGB frames before being segmented, which increases…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Weidong Chen , Dexiang Hong , Yuankai Qi , Zhenjun Han , Shuhui Wang , Laiyun Qing , Qingming Huang , Guorong Li

The recent works on Video Object Segmentation achieved remarkable results by matching dense semantic and instance-level features between the current and previous frames for long-time propagation. Nevertheless, global feature matching…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Volodymyr Fedynyak , Yaroslav Romanus , Bohdan Hlovatskyi , Bohdan Sydor , Oles Dobosevych , Igor Babin , Roman Riazantsev

Referring image segmentation is a challenging task that involves generating pixel-wise segmentation masks based on natural language descriptions. The complexity of this task increases with the intricacy of the sentences provided. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Hai Nguyen-Truong , E-Ro Nguyen , Tuan-Anh Vu , Minh-Triet Tran , Binh-Son Hua , Sai-Kit Yeung

Unsupervised video object segmentation (UVOS) is a per-pixel binary labeling problem which aims at separating the foreground object from the background in the video without using the ground truth (GT) mask of the foreground object. Most of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Youngjo Lee , Hongje Seong , Euntai Kim

In the booming video era, video segmentation attracts increasing research attention in the multimedia community. Semi-supervised video object segmentation (VOS) aims at segmenting objects in all target frames of a video, given annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Xiaohao Xu , Jinglu Wang , Xiang Ming , Yan Lu

Interactive segmentation aims to accurately segment target objects with minimal user interactions. However, current methods often fail to accurately separate target objects from the background, due to a limited understanding of order, the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Bin Wang , Anwesa Choudhuri , Meng Zheng , Zhongpai Gao , Benjamin Planche , Andong Deng , Qin Liu , Terrence Chen , Ulas Bagci , Ziyan Wu

Interactive segmentation aims to segment the specified target on the image with positive and negative clicks from users. Interactive ambiguity is a crucial issue in this field, which refers to the possibility of multiple compliant outcomes…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Zheng Lin , Nan Zhou , Chen-Xi Du , Deng-Ping Fan , Shi-Min Hu

Referring Video Object Segmentation (RVOS) requires segmenting the object in video referred by a natural language query. Existing methods mainly rely on sophisticated pipelines to tackle such cross-modal task, and do not explicitly model…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Ping Li , Yu Zhang , Li Yuan , Xianghua Xu

Referring Image Segmentation (RIS) aims to segment a target object described by a natural language expression. Existing methods have evolved by leveraging the vision information into the language tokens. To more effectively exploit visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yubin Cho , Hyunwoo Yu , Kyeongbo Kong , Kyomin Sohn , Bongjoon Hyun , Suk-Ju Kang

Video Instance Segmentation (VIS) aims at segmenting and categorizing objects in videos from a closed set of training categories, lacking the generalization ability to handle novel categories in real-world videos. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Haochen Wang , Cilin Yan , Shuai Wang , Xiaolong Jiang , XU Tang , Yao Hu , Weidi Xie , Efstratios Gavves

We address semi-supervised video object segmentation, the task of automatically generating accurate and consistent pixel masks for objects in a video sequence, given the first-frame ground truth annotations. Towards this goal, we present…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Jonathon Luiten , Paul Voigtlaender , Bastian Leibe

We present a deep learning method for the interactive video object segmentation. Our method is built upon two core operations, interaction and propagation, and each operation is conducted by Convolutional Neural Networks. The two networks…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Seoung Wug Oh , Joon-Young Lee , Ning Xu , Seon Joo Kim

The audio-visual segmentation (AVS) task aims to segment sounding objects from a given video. Existing works mainly focus on fusing audio and visual features of a given video to achieve sounding object masks. However, we observed that prior…

Sound · Computer Science 2023-08-02 Chen Liu , Peike Li , Xingqun Qi , Hu Zhang , Lincheng Li , Dadong Wang , Xin Yu