English
Related papers

Related papers: Towards Segmenting Anything That Moves

200 papers

Video Instance Segmentation is a fundamental computer vision task that deals with segmenting and tracking object instances across a video sequence. Most existing methods typically accomplish this task by employing a multi-stage top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Jyoti Kini , Mubarak Shah

The human ability to detect and segment moving objects works in the presence of multiple objects, complex background geometry, motion of the observer, and even camouflage. In addition to all of this, the ability to detect motion is nearly…

Computer Vision and Pattern Recognition · Computer Science 2016-04-04 Pia Bideau , Erik Learned-Miller

Object tracking can be formulated as "finding the right object in a video". We observe that recent approaches for class-agnostic tracking tend to focus on the "finding" part, but largely overlook the "object" part of the task, essentially…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 Achal Dave , Pavel Tokmakov , Cordelia Schmid , Deva Ramanan

The robust association of the same objects across video frames in complex scenes is crucial for many applications, especially Multiple Object Tracking (MOT). Current methods predominantly rely on labeled domain-specific video datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Siyuan Li , Lei Ke , Martin Danelljan , Luigi Piccinelli , Mattia Segu , Luc Van Gool , Fisher Yu

Learning object segmentation in image and video datasets without human supervision is a challenging problem. Humans easily identify moving salient objects in videos using the gestalt principle of common fate, which suggests that what moves…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Silky Singh , Shripad Deshmukh , Mausoom Sarkar , Balaji Krishnamurthy

The advancement of computer vision has pushed visual analysis tasks from still images to the video domain. In recent years, video instance segmentation, which aims to track and segment multiple objects in video frames, has drawn much…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Yiming Cui , Cheng Han , Dongfang Liu

We propose a light-weight variational framework for online tracking of object segmentations in videos based on optical flow and image boundaries. While high-end computer vision methods on this task rely on sequence specific training of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Amirhossein Kardoost , Sabine Müller , Joachim Weickert , Margret Keuper

Recent works have shown that objects discovery can largely benefit from the inherent motion information in video data. However, these methods lack a proper background processing, resulting in an over-segmentation of the non-object regions…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Sandra Kara , Hejer Ammar , Florian Chabot , Quoc-Cuong Pham

We propose a new approach to learn to segment multiple image objects without manual supervision. The method can extract objects form still images, but uses videos for supervision. While prior works have considered motion for segmentation, a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Laurynas Karazija , Subhabrata Choudhury , Iro Laina , Christian Rupprecht , Andrea Vedaldi

In moving camera videos, motion segmentation is commonly performed using the image plane motion of pixels, or optical flow. However, objects that are at different depths from the camera can exhibit different optical flows even if they share…

Computer Vision and Pattern Recognition · Computer Science 2015-11-06 Manjunath Narayana , Allen Hanson , Erik Learned-Miller

Recently, Minimum Cost Multicut Formulations have been proposed and proven to be successful in both motion trajectory segmentation and multi-target tracking scenarios. Both tasks benefit from decomposing a graphical model into an optimal…

Computer Vision and Pattern Recognition · Computer Science 2016-07-22 Margret Keuper , Siyu Tang , Yu Zhongjie , Bjoern Andres , Thomas Brox , Bernt Schiele

The objective of this paper is a model that is able to discover, track and segment multiple moving objects in a video. We make four contributions: First, we introduce an object-centric segmentation model with a depth-ordered layer…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Junyu Xie , Weidi Xie , Andrew Zisserman

Segmentation of moving objects in dynamic scenes is a key process in scene understanding for navigation tasks. Classical cameras suffer from motion blur in such scenarios rendering them effete. On the contrary, event cameras, because of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Chethan M. Parameshwara , Nitin J. Sanket , Chahat Deep Singh , Cornelia Fermüller , Yiannis Aloimonos

We propose an adversarial contextual model for detecting moving objects in images. A deep neural network is trained to predict the optical flow in a region using information from everywhere else but that region (context), while another…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Yanchao Yang , Antonio Loquercio , Davide Scaramuzza , Stefano Soatto

We propose an end-to-end learning framework for segmenting generic objects in both images and videos. Given a novel image or video, our approach produces a pixel-level mask for all "object-like" regions---even for object categories never…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Bo Xiong , Suyog Dutt Jain , Kristen Grauman

Inspired by the complementarity between conventional frame-based and bio-inspired event-based cameras, we propose a multi-modal based approach to fuse visual cues from the frame- and event-domain to enhance the single object tracking…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jiqing Zhang , Xin Yang , Yingkai Fu , Xiaopeng Wei , Baocai Yin , Bo Dong

Existing deep learning based unsupervised video object segmentation methods still rely on ground-truth segmentation masks to train. Unsupervised in this context only means that no annotated frames are used during inference. As obtaining…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Sahir Shrestha , Mohammad Ali Armin , Hongdong Li , Nick Barnes

During about 30 years, a lot of research teams have worked on the big challenge of detection of moving objects in various challenging environments. First applications concern static cameras but with the rise of the mobile sensors studies on…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Marie-Neige Chapel , Thierry Bouwmans

Class-agnostic image segmentation is a crucial component in automating image editing workflows, especially in contexts where object selection traditionally involves interactive tools. Existing methods in the literature often adhere to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Sebastian Dille , Ari Blondal , Sylvain Paris , Yağız Aksoy

This work addresses motion-guided few-shot video object segmentation (FSVOS), which aims to segment dynamic objects in videos based on a few annotated examples with the same motion patterns. Existing FSVOS datasets and methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Kaining Ying , Hengrui Hu , Henghui Ding