中文
相关论文

相关论文: Long-RVOS: A Comprehensive Benchmark for Long-term…

200 篇论文

Multimodal referring segmentation aims to segment target objects in visual scenes, such as images, videos, and 3D scenes, based on referring expressions in text or audio format. This task plays a crucial role in practical applications…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Henghui Ding , Song Tang , Shuting He , Chang Liu , Zuxuan Wu , Yu-Gang Jiang

Despite advances in Large Multi-modal Models, applying them to long and untrimmed video content remains challenging due to limitations in context length and substantial memory overhead. These constraints often lead to significant…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Junho Kim , Hyunjun Kim , Hosu Lee , Yong Man Ro

This report presents an overview of the 7th Large-scale Video Object Segmentation (LSVOS) Challenge held in conjunction with ICCV 2025. Besides the two traditional tracks of LSVOS that jointly target robustness in realistic video scenarios:…

In this paper, we introduce a variant of video object segmentation (VOS) that bridges interactive and semi-automatic approaches, termed Lazy Video Object Segmentation (ziVOS). In contrast, to both tasks, which handle video object…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Stéphane Vujasinović , Stefan Becker , Sebastian Bullinger , Norbert Scherer-Negenborn , Michael Arens , Rainer Stiefelhagen

Referring Video Object Segmentation (RVOS) aims to segment and track objects in videos based on natural language expressions, requiring precise alignment between visual content and textual queries. However, existing methods often suffer…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Seunghun Lee , Jiwan Seo , Jeonghoon Kim , Sungho Moon , Siwon Kim , Haeun Yun , Hyogyeong Jeon , Wonhyeok Choi , Jaehoon Jeong , Zane Durante , Sang Hyun Park , Sunghoon Im

Referring multi-object tracking (RMOT) is an emerging cross-modal task that aims to locate an arbitrary number of target objects and maintain their identities referred by a language expression in a video. This intricate task involves the…

计算机视觉与模式识别 · 计算机科学 2024-10-18 Changcheng Xiao , Qiong Cao , Yujie Zhong , Xiang Zhang , Tao Wang , Canqun Yang , Long Lan

Recently, transformer-based approaches have shown promising results for semi-supervised video object segmentation. However, these approaches typically struggle on long videos due to increased GPU memory demands, as they frequently expand…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Abdelrahman Shaker , Syed Talal Wasim , Martin Danelljan , Salman Khan , Ming-Hsuan Yang , Fahad Shahbaz Khan

This work addresses motion-guided few-shot video object segmentation (FSVOS), which aims to segment dynamic objects in videos based on a few annotated examples with the same motion patterns. Existing FSVOS datasets and methods typically…

计算机视觉与模式识别 · 计算机科学 2025-07-30 Kaining Ying , Hengrui Hu , Henghui Ding

Recent state-of-the-art semi-supervised Video Object Segmentation (VOS) methods have shown significant improvements in target object segmentation accuracy when information from preceding frames is used in segmenting the current frame. In…

计算机视觉与模式识别 · 计算机科学 2024-02-15 Amir Nazemi , Mohammad Javad Shafiee , Zahra Gharaee , Paul Fieguth

Video object segmentation aims at accurately segmenting the target object regions across consecutive frames. It is technically challenging for coping with complicated factors (e.g., shape deformations, occlusion and out of the lens). Recent…

计算机视觉与模式识别 · 计算机科学 2019-07-03 Peng Sun , Peiwen Lin , Guangliang Cheng , Jianping Shi , Jiawan Zhang , Xi Li

Current state-of-the-art Video Object Segmentation (VOS) methods rely on dense per-object mask annotations both during training and testing. This requires time-consuming and costly video annotation mechanisms. We propose a novel Point-VOS…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Idil Esen Zulfikar , Sabarinath Mahadevan , Paul Voigtlaender , Bastian Leibe

Referring video object segmentation (RVOS) aims to segment objects in a video according to textual descriptions, which requires the integration of multimodal information and temporal dynamics perception. The Segment Anything Model 2 (SAM 2)…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Fu Rong , Meng Lan , Qian Zhang , Lefei Zhang

In this paper we introduce a Transformer-based approach to video object segmentation (VOS). To address compounding error and scalability issues of prior work, we propose a scalable, end-to-end method for VOS called Sparse Spatiotemporal…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Brendan Duke , Abdalla Ahmed , Christian Wolf , Parham Aarabi , Graham W. Taylor

Egocentric Referring Video Object Segmentation (Ego-RVOS) aims to segment the specific object actively involved in a human action, as described by a language query, within first-person videos. This task is critical for understanding…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Haijing Liu , Zhiyuan Song , Hefeng Wu , Tao Pu , Keze Wang , Liang Lin

Recent efforts in video reasoning segmentation (VRS) integrate large language models (LLMs) with perception models to localize and track objects via textual instructions, achieving barely satisfactory results in simple scenarios. However,…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Yu Qiao , Hengshuang Zhao

Video Object Segmentation, and video processing in general, has been historically dominated by methods that rely on the temporal consistency and redundancy in consecutive video frames. When the temporal smoothness is suddenly broken, such…

计算机视觉与模式识别 · 计算机科学 2018-05-17 Kevis-Kokitsi Maninis , Sergi Caelles , Yuhua Chen , Jordi Pont-Tuset , Laura Leal-Taixé , Daniel Cremers , Luc Van Gool

Comprehending long videos remains a significant challenge for Large Multi-modal Models (LMMs). Current LMMs struggle to process even minutes to hours videos due to their lack of explicit memory and retrieval mechanisms. To address this…

计算机视觉与模式识别 · 计算机科学 2025-05-07 Sameer Malik , Moyuru Yamada , Ayush Singh , Dishank Aggarwal

We segment moving objects in videos by ranking spatio-temporal segment proposals according to "moving objectness": how likely they are to contain a moving object. In each video frame, we compute segment proposals using multiple…

计算机视觉与模式识别 · 计算机科学 2015-05-11 Katerina Fragkiadaki , Pablo Arbelaez , Panna Felsen , Jitendra Malik

Referring video object segmentation aims to segment a referent throughout a video sequence according to a natural language expression. It requires aligning the natural language expression with the objects' motions and their dynamic…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Jiajin Tang , Ge Zheng , Sibei Yang

Video object segmentation (VOS) is a highly challenging problem since the initial mask, defining the target object, is only given at test-time. The main difficulty is to effectively handle appearance changes and similar background objects,…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Andreas Robinson , Felix Järemo Lawin , Martin Danelljan , Fahad Shahbaz Khan , Michael Felsberg