English
Related papers

Related papers: Siamese Network with Interactive Transformer for V…

200 papers

Video Instance Segmentation (VIS) jointly tackles multi-object detection, tracking, and segmentation in video sequences. In the past, VIS methods mirrored the fragmentation of these subtasks in their architectural design, hence missing out…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Adrià Caelles , Tim Meinhardt , Guillem Brasó , Laura Leal-Taixé

In this paper, we show that transferring knowledge from other domains of video understanding combined with large-scale learning can improve robustness of Video Object Segmentation (VOS) under complex circumstances. Namely, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Volodymyr Fedynyak , Yaroslav Romanus , Oles Dobosevych , Igor Babin , Roman Riazantsev

Video Object Segmentation (VOS) is fundamental to video understanding. Transformer-based methods show significant performance improvement on semi-supervised VOS. However, existing work faces challenges segmenting visually similar objects in…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Ye Yu , Jialin Yuan , Gaurav Mittal , Li Fuxin , Mei Chen

Video object segmentation (VOS) is a critical task in the development of video perception and understanding. The Segment-Anything Model 2 (SAM 2), released by Meta AI, is the current state-of-the-art architecture for end-to-end VOS. SAM 2…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Clayton Bromley , Alexander Moore , Amar Saini , Doug Poland , Carmen Carrano

Delving into the realm of egocentric vision, the advancement of referring video object segmentation (RVOS) stands as pivotal in understanding human activities. However, existing RVOS task primarily relies on static attributes such as object…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Liangyang Ouyang , Ruicong Liu , Yifei Huang , Ryosuke Furuta , Yoichi Sato

While current methods for interactive Video Object Segmentation (iVOS) rely on scribble-based interactions to generate precise object masks, we propose a Click-based interactive Video Object Segmentation (CiVOS) framework to simplify the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Stephane Vujasinovic , Sebastian Bullinger , Stefan Becker , Norbert Scherer-Negenborn , Michael Arens , Rainer Stiefelhagen

Service robots operating in unstructured environments must effectively recognize and segment unknown objects to enhance their functionality. Traditional supervised learningbased segmentation techniques require extensive annotated datasets,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Ying Zhang , Maoliang Yin , Wenfu Bi , Haibao Yan , Shaohan Bian , Cui-Hua Zhang , Changchun Hua

Video object segmentation aims at accurately segmenting the target object regions across consecutive frames. It is technically challenging for coping with complicated factors (e.g., shape deformations, occlusion and out of the lens). Recent…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Peng Sun , Peiwen Lin , Guangliang Cheng , Jianping Shi , Jiawan Zhang , Xi Li

Video Object Segmentation (VOS) is foundational to numerous computer vision applications, including surveillance, autonomous driving, robotics and generative video editing. However, existing VOS models often struggle with precise mask…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Elham Soltani Kazemi , Imad Eddine Toubal , Gani Rahmon , Jaired Collins , K. Palaniappan

The Segment Anything Model (SAM) has gained significant attention for its impressive performance in image segmentation. However, it lacks proficiency in referring video object segmentation (RVOS) due to the need for precise user-interactive…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yonglin Li , Jing Zhang , Xiao Teng , Long Lan , Xinwang Liu

Referential Video Object Segmentation (RVOS) aims to segment all objects in a video that match a given natural language description, bridging the gap between vision and language understanding. Recent work, such as Sa2VA, combines Large…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Ran Hong , Feng Lu , Leilei Cao , An Yan , Youhai Jiang , Fengjie Zhu

In this paper, we introduce a variant of video object segmentation (VOS) that bridges interactive and semi-automatic approaches, termed Lazy Video Object Segmentation (ziVOS). In contrast, to both tasks, which handle video object…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Stéphane Vujasinović , Stefan Becker , Sebastian Bullinger , Norbert Scherer-Negenborn , Michael Arens , Rainer Stiefelhagen

In the booming video era, video segmentation attracts increasing research attention in the multimedia community. Semi-supervised video object segmentation (VOS) aims at segmenting objects in all target frames of a video, given annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Xiaohao Xu , Jinglu Wang , Xiang Ming , Yan Lu

Video object segmentation (VOS) -- predicting pixel-level regions for objects within each frame of a video -- is particularly challenging in agricultural scenarios, where videos of crops include hundreds of small, dense, and occluded…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Keyhan Najafian , Farhad Maleki , Lingling Jin , Ian Stavness

Video Object Segmentation, and video processing in general, has been historically dominated by methods that rely on the temporal consistency and redundancy in consecutive video frames. When the temporal smoothness is suddenly broken, such…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Kevis-Kokitsi Maninis , Sergi Caelles , Yuhua Chen , Jordi Pont-Tuset , Laura Leal-Taixé , Daniel Cremers , Luc Van Gool

Referring Video Object Segmentation (RVOS) relies on natural language expressions to segment an object in a video clip. Existing methods restrict reasoning either to independent short clips, losing global context, or process the entire…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Claudia Cuttano , Gabriele Trivigno , Gabriele Rosi , Carlo Masone , Giuseppe Averta

We introduce a novel network, called CO-attention Siamese Network (COSNet), to address the unsupervised video object segmentation task from a holistic view. We emphasize the importance of inherent correlation among video frames and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Xiankai Lu , Wenguan Wang , Chao Ma , Jianbing Shen , Ling Shao , Fatih Porikli

Semi-supervised video object segmentation (VOS) aims to densely track certain designated objects in videos. One of the main challenges in this task is the existence of background distractors that appear similar to the target objects. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Suhwan Cho , Heansung Lee , Minhyeok Lee , Chaewon Park , Sungjun Jang , Minjung Kim , Sangyoun Lee

In this work we present SwiftNet for real-time semisupervised video object segmentation (one-shot VOS), which reports 77.8% J &F and 70 FPS on DAVIS 2017 validation dataset, leading all present solutions in overall accuracy and speed…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Haochen Wang , Xiaolong Jiang , Haibing Ren , Yao Hu , Song Bai

Video Object Segmentation (VOS) task aims to segment objects in videos. However, previous settings either require time-consuming manual masks of target objects at the first frame during inference or lack the flexibility to specify arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Pinxue Guo , Lingyi Hong , Xinyu Zhou , Shuyong Gao , Wanyun Li , Jinglun Li , Zhaoyu Chen , Xiaoqiang Li , Wei Zhang , Wenqiang Zhang