English
Related papers

Related papers: Self-supervised Video Object Segmentation by Motio…

200 papers

The problem of determining whether an object is in motion, irrespective of camera motion, is far from being solved. We address this challenging task by learning motion patterns in videos. The core of our approach is a fully convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Pavel Tokmakov , Karteek Alahari , Cordelia Schmid

Action segmentation of behavioral videos is the process of labeling each frame as belonging to one or more discrete classes, and is a crucial component of many studies that investigate animal behavior. A wide range of algorithms exist to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Ari Blau , Evan S Schaffer , Neeli Mishra , Nathaniel J Miska , The International Brain Laboratory , Liam Paninski , Matthew R Whiteway

We present a self-supervised learning framework to estimate the individual object motion and monocular depth from video. We model the object motion as a 6 degree-of-freedom rigid-body transformation. The instance segmentation mask is…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Qi Dai , Vaishakh Patil , Simon Hecker , Dengxin Dai , Luc Van Gool , Konrad Schindler

We consider the task of semi-supervised video object segmentation (VOS). Our approach mitigates shortcomings in previous VOS work by addressing detail preservation and temporal consistency using visual warping. In contrast to prior work…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Julia Gong , F. Christopher Holsinger , Serena Yeung

Learning object segmentation in image and video datasets without human supervision is a challenging problem. Humans easily identify moving salient objects in videos using the gestalt principle of common fate, which suggests that what moves…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Silky Singh , Shripad Deshmukh , Mausoom Sarkar , Balaji Krishnamurthy

Segmenting foreground object from a video is a challenging task because of the large deformations of the objects, occlusions, and background clutter. In this paper, we propose a frame-by-frame but computationally efficient approach for…

Computer Vision and Pattern Recognition · Computer Science 2017-06-30 Aditya Vora , Shanmuganathan Raman

In this work we propose a capsule-based approach for semi-supervised video object segmentation. Current video object segmentation methods are frame-based and often require optical flow to capture temporal consistency across frames which can…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Kevin Duarte , Yogesh S Rawat , Mubarak Shah

Weakly supervised instance segmentation has gained popularity because it reduces high annotation cost of pixel-level masks required for model training. Recent approaches for weakly supervised instance segmentation detect and segment objects…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Jun Ikeda , Junichiro Mori

Video object segmentation is a fundamental step in many advanced vision applications. Most existing algorithms are based on handcrafted features such as HOG, super-pixel segmentation or texture-based techniques, while recently deep features…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Maryam Sultana , Arif Mahmood , Sajid Javed , Soon Ki Jung

Video Object Segmentation (VOS) has been targeted by various fully-supervised and self-supervised approaches. While fully-supervised methods demonstrate excellent results, self-supervised ones, which do not use pixel-level ground truth,…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Tanveer Hannan , Rajat Koner , Jonathan Kobold , Matthias Schubert

The objective of this paper is a model that is able to discover, track and segment multiple moving objects in a video. We make four contributions: First, we introduce an object-centric segmentation model with a depth-ordered layer…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Junyu Xie , Weidi Xie , Andrew Zisserman

Semi-supervised video object segmentation (VOS) aims to segment a few moving objects in a video sequence, where these objects are specified by annotation of first frame. The optical flow has been considered in many existing semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Ziyang Liu , Jingmeng Liu , Weihai Chen , Xingming Wu , Zhengguo Li

We present an approach to semi-supervised video object segmentation, in the context of the DAVIS 2017 challenge. Our approach combines category-based object detection, category-independent object appearance segmentation and temporal object…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Gilad Sharir , Eddie Smolyansky , Itamar Friedman

Visual segmentation seeks to partition images, video frames, or point clouds into multiple segments or groups. This technique has numerous real-world applications, such as autonomous driving, image editing, robot sensing, and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiangtai Li , Henghui Ding , Haobo Yuan , Wenwei Zhang , Jiangmiao Pang , Guangliang Cheng , Kai Chen , Ziwei Liu , Chen Change Loy

Video object segmentation is a fundamental research problem in computer vision. Recent techniques have often applied attention mechanism to object representation learning from video sequences. However, due to temporal changes in the video…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Quang-Trung Truong , Duc Thanh Nguyen , Binh-Son Hua , Sai-Kit Yeung

Video object segmentation targets at segmenting a specific object throughout a video sequence, given only an annotated first frame. Recent deep learning based approaches find it effective by fine-tuning a general-purpose segmentation model…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Linjie Yang , Yanran Wang , Xuehan Xiong , Jianchao Yang , Aggelos K. Katsaggelos

Distinguishing visually similar objects by their motion remains a critical challenge in computer vision. Although supervised trackers show promise, contemporary self-supervised trackers struggle when visual cues become ambiguous, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Chenshuang Zhang , Kang Zhang , Joon Son Chung , In So Kweon , Junmo Kim , Chengzhi Mao

Video amodal segmentation is a particularly challenging task in computer vision, which requires to deduce the full shape of an object from the visible parts of it. Recently, some studies have achieved promising performance by using motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Ke Fan , Jingshi Lei , Xuelin Qian , Miaopeng Yu , Tianjun Xiao , Tong He , Zheng Zhang , Yanwei Fu

The goal of video segmentation is to turn video data into a set of concrete motion clusters that can be easily interpreted as building blocks of the video. There are some works on similar topics like detecting scene cuts in a video, but…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Hajar Sadeghi Sokeh , Vasileios Argyriou , Dorothy Monekosso , Paolo Remagnino

This paper presents a new self-supervised system for learning to detect novel and previously unseen categories of objects in images. The proposed system receives as input several unlabeled videos of scenes containing various objects. The…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Juntao Tan , Changkyu Song , Abdeslam Boularias