English
Related papers

Related papers: Learning to Segment Moving Objects in Videos

200 papers

Learning a data-driven spatio-temporal semantic representation of the objects is the key to coherent and consistent labelling in video. This paper proposes to achieve semantic video object segmentation by learning a data-driven…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Tinghuai Wang

In this paper, we propose an unsupervised video object co-segmentation framework based on the primary object proposals to extract the common foreground object(s) from a given video set. In addition to the objectness attributes and motion…

Computer Vision and Pattern Recognition · Computer Science 2018-02-12 Michael Ying Yang , Matthias Reso , Jun Tang , Wentong Liao , Bodo Rosenhahn

This paper presents a novel approach for segmenting moving objects in unconstrained environments using guided convolutional neural networks. This guiding process relies on foreground masks from independent algorithms (i.e. state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Diego Ortego , Kevin McGuinness , Juan C. SanMiguel , Eric Arazo , José M. Martínez , Noel E. O'Connor

We describe an approach for segmenting an image into regions that correspond to surfaces in the scene that are partially surrounded by the medium. It integrates both appearance and motion statistics into a cost functional, that is seeded…

Computer Vision and Pattern Recognition · Computer Science 2011-09-23 Alper Ayvaci , Stefano Soatto

We propose a new approach to learn to segment multiple image objects without manual supervision. The method can extract objects form still images, but uses videos for supervision. While prior works have considered motion for segmentation, a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Laurynas Karazija , Subhabrata Choudhury , Iro Laina , Christian Rupprecht , Andrea Vedaldi

Motion, measured via optical flow, provides a powerful cue to discover and learn objects in images and videos. However, compared to using appearance, it has some blind spots, such as the fact that objects become invisible if they do not…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Subhabrata Choudhury , Laurynas Karazija , Iro Laina , Andrea Vedaldi , Christian Rupprecht

Video object segmentation, i.e., the separation of a target object from background in video, has made significant progress on real and challenging videos in recent years. To leverage this progress in 3D applications, this paper addresses…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Brent A. Griffin , Jason J. Corso

Observable motion in videos can give rise to the definition of objects moving with respect to the scene. The task of segmenting such moving objects is referred to as motion segmentation and is usually tackled either by aggregating motion…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Amirhossein Kardoost , Kalun Ho , Peter Ochs , Margret Keuper

The objective of this paper is motion segmentation -- discovering and segmenting the moving objects in a video. This is a much studied area with numerous careful, and sometimes complex, approaches and training schemes including:…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Junyu Xie , Charig Yang , Weidi Xie , Andrew Zisserman

In moving camera videos, motion segmentation is commonly performed using the image plane motion of pixels, or optical flow. However, objects that are at different depths from the camera can exhibit different optical flows even if they share…

Computer Vision and Pattern Recognition · Computer Science 2015-11-06 Manjunath Narayana , Allen Hanson , Erik Learned-Miller

We introduce a prediction driven method for visual tracking and segmentation in videos. Instead of solely relying on matching with appearance cues for tracking, we build a predictive model which guides finding more accurate tracking regions…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jianren Wang , Yihui He , Xiaobo Wang , Xinjia Yu , Xia Chen

We propose a Spatiotemporal Sampling Network (STSN) that uses deformable convolutions across time for object detection in videos. Our STSN performs object detection in a video frame by learning to spatially sample features from the adjacent…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Gedas Bertasius , Lorenzo Torresani , Jianbo Shi

Identifying and segmenting moving objects from a moving monocular camera is difficult when there is unknown camera motion, different types of object motions and complex scene structures. To tackle these challenges, we take advantage of two…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Yuxiang Huang , John Zelek

Most tracking-by-detection methods employ a local search window around the predicted object location in the current frame assuming the previous location is accurate, the trajectory is smooth, and the computational capacity permits a search…

Computer Vision and Pattern Recognition · Computer Science 2015-12-01 Gao Zhu , Fatih Porikli , Hongdong Li

Object detection in videos has drawn increasing attention recently with the introduction of the large-scale ImageNet VID dataset. Different from object detection in static images, temporal information in videos is vital for object…

Computer Vision and Pattern Recognition · Computer Science 2018-01-10 Kai Kang , Hongsheng Li , Tong Xiao , Wanli Ouyang , Junjie Yan , Xihui Liu , Xiaogang Wang

This work is in the field of video surveillance including motion detection. The video surveillance is one of essential techniques for automatic video analysis to extract crucial information or relevant scenes in video surveillance systems.…

Computer Vision and Pattern Recognition · Computer Science 2016-08-15 Larbi Guezouli , Hanane Belhani

In this paper, we propose Spatio-TEmporal Progressive (STEP) action detector---a progressive learning framework for spatio-temporal action detection in videos. Starting from a handful of coarse-scale proposal cuboids, our approach…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Xitong Yang , Xiaodong Yang , Ming-Yu Liu , Fanyi Xiao , Larry Davis , Jan Kautz

The goal of this paper is to discover, segment, and track independently moving objects in complex visual scenes. Previous approaches have explored the use of optical flow for motion segmentation, leading to imperfect predictions due to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Junyu Xie , Weidi Xie , Andrew Zisserman

The ability to detect and segment moving objects in a scene is essential for building consistent maps, making future state predictions, avoiding collisions, and planning. In this paper, we address the problem of moving object segmentation…

We propose a novel solution for semi-supervised video object segmentation. By the nature of the problem, available cues (e.g. video frame(s) with object masks) become richer with the intermediate predictions. However, the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Seoung Wug Oh , Joon-Young Lee , Ning Xu , Seon Joo Kim