English
Related papers

Related papers: Memory Aggregation Networks for Efficient Interact…

200 papers

Large-scale Video Object Segmentation (LSVOS) addresses the challenge of accurately tracking and segmenting objects in long video sequences, where difficulties stem from object reappearance, small-scale targets, heavy occlusions, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yujie Xie , Hongyang Zhang , Zhihui Liu , Shihai Ruan

Due to the problem of performance constraints of unsupervised video object detection, its large-scale application is limited. In response to this pain point, we propose another excellent method to solve this problematic point. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Chao Hu , Liqiang Zhu

In this work we present a novel solution for Video Instance Segmentation(VIS), that is automatically generating instance level segmentation masks along with object class and tracking them in a video. Our method improves the masks from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Vidit Goel , Jiachen Li , Shubhika Garg , Harsh Maheshwari , Humphrey Shi

Few-Shot Video Object Segmentation (FSVOS) aims to segment objects in a query video with the same category defined by a few annotated support images. However, this task was seldom explored. In this work, based on IPMT, a state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Nian Liu , Kepan Nan , Wangbo Zhao , Yuanwei Liu , Xiwen Yao , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer , Junwei Han , Fahad Shahbaz Khan

Video instance segmentation aims to detect, segment, and track objects in a video. Current approaches extend image-level segmentation algorithms to the temporal domain. However, this results in temporally inconsistent masks. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Anirudh S Chakravarthy , Won-Dong Jang , Zudi Lin , Donglai Wei , Song Bai , Hanspeter Pfister

Reasoning Video Object Segmentation (ReasonVOS) is a challenging task that requires stable object segmentation across video sequences using implicit and complex textual inputs. Previous methods fine-tune Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhengtong Zhu , Jiaqing Fan , Zhixuan Liu , Fanzhang Li

Intelligent robots need to interact with diverse objects across various environments. The appearance and state of objects frequently undergo complex transformations depending on the object properties, e.g., phase transitions. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zixuan Chen , Jiaxin Li , Liming Tan , Yejie Guo , Junxuan Liang , Cewu Lu , Yong-Lu Li

Amodal perception requires inferring the full shape of an object that is partially occluded. This task is particularly challenging on two levels: (1) it requires more information than what is contained in the instant retina or imaging…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Jian Yao , Yuxin Hong , Chiyu Wang , Tianjun Xiao , Tong He , Francesco Locatello , David Wipf , Yanwei Fu , Zheng Zhang

This paper investigates how to realize better and more efficient embedding learning to tackle the semi-supervised video object segmentation under challenging multi-object scenarios. The state-of-the-art methods learn to decode features with…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Zongxin Yang , Yunchao Wei , Yi Yang

State-of-the-art video object detection methods maintain a memory structure, either a sliding window or a memory queue, to enhance the current frame using attention mechanisms. However, we argue that these memory structures are not…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Guanxiong Sun , Yang Hua , Guosheng Hu , Neil Robertson

Referring Video Object Segmentation (RVOS) aims to segment target objects throughout a video based on a text description. This task has attracted increasing attention in the field of computer vision due to its promising applications in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Tianming Liang , Haichao Jiang , Wei-Shi Zheng , Jian-Fang Hu

Video object segmentation can be considered as one of the most challenging computer vision problems. Indeed, so far, no existing solution is able to effectively deal with the peculiarities of real-world videos, especially in cases of…

Computer Vision and Pattern Recognition · Computer Science 2016-01-06 Simone Palazzo , Concetto Spampinato , Daniela Giordano

Instance segmentation with unseen objects is a challenging problem in unstructured environments. To solve this problem, we propose a robot learning approach to actively interact with novel objects and collect each object's training label…

Robotics · Computer Science 2022-07-22 Houjian Yu , Changhyun Choi

Referring video object segmentation (RVOS) is a challenging task that requires the model to segment the object in a video given the language description. MeViS is a recently proposed dataset that contains motion expressions of the target…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Haobo Yuan , Tao Zhang , Xiangtai Li , Lu Qi , Zilong Huang , Shilin Xu , Jiashi Feng , Ming-Hsuan Yang

The referring video object segmentation task (RVOS) aims to segment object instances in a given video referred by a language expression in all video frames. Due to the requirement of understanding cross-modal semantics within individual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Leilei Cao , Zhuang Li , Bo Yan , Feng Zhang , Fengliang Qi , Yuchen Hu , Hongbin Wang

Dynamic scene understanding is one of the most conspicuous field of interest among computer vision community. In order to enhance dynamic scene understanding, pixel-wise segmentation with neural networks is widely accepted. The latest…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Ge Shi , Zhili Yang

Although deep learning methods have achieved advanced video object recognition performance in recent years, perceiving heavily occluded objects in a video is still a very challenging task. To promote the development of occlusion…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Jiyang Qi , Yan Gao , Yao Hu , Xinggang Wang , Xiaoyu Liu , Xiang Bai , Serge Belongie , Alan Yuille , Philip H. S. Torr , Song Bai

Referring video object segmentation (RVOS) aims to identify, track and segment the objects in a video based on language descriptions, which has received great attention in recent years. However, existing datasets remain focus on short video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Tianming Liang , Haichao Jiang , Yuting Yang , Chaolei Tan , Shuai Li , Wei-Shi Zheng , Jian-Fang Hu

Modern video object segmentation (VOS) algorithms have achieved remarkably high performance in a sequential processing order, while most of currently prevailing pipelines still show some obvious inadequacy like accumulative error, unknown…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Yuxi Li , Ning Xu , Wenjie Yang , John See , Weiyao Lin

Video instance segmentation (VIS) aims to segment and associate all instances of predefined classes for each frame in videos. Prior methods usually obtain segmentation for a frame or clip first, and merge the incomplete results by tracking…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Huaijia Lin , Ruizheng Wu , Shu Liu , Jiangbo Lu , Jiaya Jia