English
Related papers

Related papers: Tsanet: Temporal and Scale Alignment for Unsupervi…

200 papers

Multi-instance video object segmentation is to segment specific instances throughout a video sequence in pixel level, given only an annotated first frame. In this paper, we implement an effective fully convolutional networks with U-Net…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Heguang Liu , Jingle Jiang

Video foreground segmentation (VFS) is an important computer vision task wherein one aims to segment the objects under motion from the background. Most of the current methods are image-based, i.e., rely only on spatial cues while ignoring…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Praveen Kumar Pokala , Jaya Sai Kiran Patibandla , Naveen Kumar Pandey , Balakrishna Reddy Pailla

Video object segmentation is a fundamental research problem in computer vision. Recent techniques have often applied attention mechanism to object representation learning from video sequences. However, due to temporal changes in the video…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Quang-Trung Truong , Duc Thanh Nguyen , Binh-Son Hua , Sai-Kit Yeung

Segmentation of objects in a video is challenging due to the nuances such as motion blurring, parallax, occlusions, changes in illumination, etc. Instead of addressing these nuances separately, we focus on building a generalizable solution…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Silky Singh , Shripad Deshmukh , Mausoom Sarkar , Rishabh Jain , Mayur Hemani , Balaji Krishnamurthy

Referring video object segmentation (RVOS) aims to segment the target instance in a video, referred by a text expression. Conventional approaches are mostly supervised learning, requiring expensive pixel-level mask annotations. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Miaojing Shi , Jun Huang , Zijie Yue , Hanli Wang

We propose a simple, yet powerful approach for unsupervised object segmentation in videos. We introduce an objective function whose minimum represents the mask of the main salient object over the input sequence. It only relies on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Georgy Ponimatkin , Nermin Samet , Yang Xiao , Yuming Du , Renaud Marlet , Vincent Lepetit

This paper presents a novel approach for segmenting moving objects in unconstrained environments using guided convolutional neural networks. This guiding process relies on foreground masks from independent algorithms (i.e. state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Diego Ortego , Kevin McGuinness , Juan C. SanMiguel , Eric Arazo , José M. Martínez , Noel E. O'Connor

Video instance segmentation (VIS) aims at classifying, segmenting and tracking object instances in video sequences. Recent transformer-based neural networks have demonstrated their powerful capability of modeling spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Xiang Li , Jinglu Wang , Xiaohao Xu , Bhiksha Raj , Yan Lu

Audio-Visual Segmentation (AVS) aims to identify and segment sound-producing objects in videos by leveraging both visual and audio modalities. It has emerged as a significant research area in multimodal perception, enabling fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jia Li , Yapeng Tian

Foreground segmentation is an essential task in the field of image understanding. Under unsupervised conditions, different images and instances always have variable expressions, which make it difficult to achieve stable segmentation…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Xi Li , Huimin Ma , Hongbing Ma , Yidong Wang

Unsupervised video object segmentation is a crucial application in video analysis without knowing any prior information about the objects. It becomes tremendously challenging when multiple objects occur and interact in a given video clip.…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Ye Wang , Jongmoo Choi , Yueru Chen , Siyang Li , Qin Huang , Kaitai Zhang , Ming-Sui Lee , C. -C. Jay Kuo

Referring video object segmentation (RVOS) aims to segment target objects throughout a video based on a text description. This is challenging as it involves deep vision-language understanding, pixel-level dense prediction and spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Tianming Liang , Kun-Yu Lin , Chaolei Tan , Jianguo Zhang , Wei-Shi Zheng , Jian-Fang Hu

Current top-leading solutions for video object segmentation (VOS) typically follow a matching-based regime: for each query frame, the segmentation mask is inferred according to its correspondence to previously processed and the first…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Yurong Zhang , Liulei Li , Wenguan Wang , Rong Xie , Li Song , Wenjun Zhang

We introduce a novel framework called RefineVIS for Video Instance Segmentation (VIS) that achieves good object association between frames and accurate segmentation masks by iteratively refining the representations using sequence context.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Andre Abrantes , Jiang Wang , Peng Chu , Quanzeng You , Zicheng Liu

Domain shift has always been one of the primary issues in video object segmentation (VOS), for which models suffer from degeneration when tested on unfamiliar datasets. Recently, many online methods have emerged to narrow the performance…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Jinshuo Zhang , Zhicheng Wang , Songyan Zhang , Gang Wei

Current semi-supervised video object segmentation (VOS) methods usually leverage the entire features of one frame to predict object masks and update memory. This introduces significant redundant computations. To reduce redundancy, we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Ajmal Mian

In this report, we introduce our (pretty straightforard) two-step "detect-then-match" video instance segmentation method. The first step performs instance segmentation for each frame to get a large number of instance mask proposals. The…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Yuming Du , Wen Guo , Yang Xiao , Vincent Lepetit

Most state-of-the-art semi-supervised video object segmentation methods rely on a pixel-accurate mask of a target object provided for the first frame of a video. However, obtaining a detailed segmentation mask is expensive and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Anna Khoreva , Anna Rohrbach , Bernt Schiele

Multiple object video object segmentation is a challenging task, specially for the zero-shot case, when no object mask is given at the initial frame and the model has to find the objects to be segmented along the sequence. In our work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Carles Ventura , Miriam Bellver , Andreu Girbau , Amaia Salvador , Ferran Marques , Xavier Giro-i-Nieto

Exploring dense matching between the current frame and past frames for long-range context modeling, memory-based methods have demonstrated impressive results in video object segmentation (VOS) recently. Nevertheless, due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Junke Wang , Dongdong Chen , Zuxuan Wu , Chong Luo , Chuanxin Tang , Xiyang Dai , Yucheng Zhao , Yujia Xie , Lu Yuan , Yu-Gang Jiang