English
Related papers

Related papers: Learning Rigidity in Dynamic Scenes with a Moving …

200 papers

This paper addresses the challenging unsupervised scene flow estimation problem by jointly learning four low-level vision sub-tasks: optical flow $\textbf{F}$, stereo-depth $\textbf{D}$, camera pose $\textbf{P}$ and motion segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yang Jiao , Trac D. Tran , Guangming Shi

We propose a data-driven scene flow estimation algorithm exploiting the observation that many 3D scenes can be explained by a collection of agents moving as rigid bodies. At the core of our method lies a deep architecture able to reason at…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Zan Gojcic , Or Litany , Andreas Wieser , Leonidas J. Guibas , Tolga Birdal

Despite significant progress in image-based 3D scene flow estimation, the performance of such approaches has not yet reached the fidelity required by many applications. Simultaneously, these applications are often not restricted to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Aseem Behl , Despoina Paschalidou , Simon Donné , Andreas Geiger

We present a method for decomposing the 3D scene flow observed from a moving stereo rig into stationary scene elements and dynamic object motion. Our unsupervised learning framework jointly reasons about the camera motion, optical flow, and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Seokju Lee , Sunghoon Im , Stephen Lin , In So Kweon

3D scene flow characterizes how the points at the current time flow to the next time in the 3D Euclidean space, which possesses the capacity to infer autonomously the non-rigid motion of all objects in the scene. The previous methods for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Chaokang Jiang , Guangming Wang , Yanzi Miao , Hesheng Wang

Appearance-based detectors achieve remarkable performance on common scenes, but tend to fail for scenarios lack of training data. Geometric motion segmentation algorithms, however, generalize to novel scenes, but have yet to achieve…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Gengshan Yang , Deva Ramanan

Scene flow estimation is the task to predict the point-wise or pixel-wise 3D displacement vector between two consecutive frames of point clouds or images, which has important application in fields such as service robots and autonomous…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Guangming Wang , Yunzhe Hu , Xinrui Wu , Hesheng Wang

Depth information is useful for many applications. Active depth sensors are appealing because they obtain dense and accurate depth maps. However, due to issues that range from power constraints to multi-sensor interference, these sensors…

Image and Video Processing · Electrical Eng. & Systems 2020-02-04 James Noraky , Vivienne Sze

Scene flow represents the 3D motion of each point in the scene, which explicitly describes the distance and the direction of each point's movement. Scene flow estimation is used in various applications such as autonomous driving fields,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Guangming Wang , Zhiheng Feng , Chaokang Jiang , Hesheng Wang

In this article, we investigate self-supervised 3D scene flow estimation and class-agnostic motion prediction on point clouds. A realistic scene can be well modeled as a collection of rigidly moving parts, therefore its scene flow can be…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Ruibo Li , Chi Zhang , Zhe Wang , Chunhua Shen , Guosheng Lin

Real-time motion detection in non-stationary scenes is a difficult task due to dynamic background, changing foreground appearance and limited computational resource. These challenges degrade the performance of the existing methods in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Junjie Huang , Wei Zou , Zheng Zhu , Jiagang Zhu

The test-time optimization of scene flow - using a coordinate network as a neural prior - has gained popularity due to its simplicity, lack of dataset bias, and state-of-the-art performance. We observe, however, that although coordinate…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Kavisha Vidanapathirana , Shin-Fang Chng , Xueqian Li , Simon Lucey

With the recent advent of methods that allow for real-time computation, dense 3D flows have become a viable basis for fast camera motion estimation. Most importantly, dense flows are more robust than the sparse feature matching techniques…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Thomas W. Mitchel , Christian Wuelker , Jin Seob Kim , Sipu Ruan , Gregory S. Chirikjian

In the paper, we propose a robust real-time visual odometry in dynamic environments via rigid-motion model updated by scene flow. The proposed algorithm consists of spatial motion segmentation and temporal motion tracking. The spatial…

Robotics · Computer Science 2019-07-22 Sangil Lee , Clark Youngdong Son , H. Jin Kim

Scene flow represents the motion of points in the 3D space, which is the counterpart of the optical flow that represents the motion of pixels in the 2D image. However, it is difficult to obtain the ground truth of scene flow in the real…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Xiaoyu Tian , Ruiqi Ding , Hesheng Wang

Given two consecutive RGB-D images, we propose a model that estimates a dense 3D motion field, also known as scene flow. We take advantage of the fact that in robot manipulation scenarios, scenes often consist of a set of rigidly moving…

Robotics · Computer Science 2018-07-25 Lin Shao , Parth Shah , Vikranth Dwaracherla , Jeannette Bohg

Given two consecutive frames from a pair of stereo cameras, 3D scene flow methods simultaneously estimate the 3D geometry and motion of the observed scene. Many existing approaches use superpixels for regularization, but may predict…

Computer Vision and Pattern Recognition · Computer Science 2017-10-09 Zhile Ren , Deqing Sun , Jan Kautz , Erik B. Sudderth

Recent geometric methods need reliable estimates of 3D motion parameters to procure accurate dense depth map of a complex dynamic scene from monocular images \cite{kumar2017monocular, ranftl2016dense}. Generally, to estimate…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Suryansh Kumar , Ram Srivatsav Ghorakavi , Yuchao Dai , Hongdong Li

We present a method to estimate depth of a dynamic scene, containing arbitrary moving objects, from an ordinary video captured with a moving camera. We seek a geometrically and temporally consistent solution to this underconstrained…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Zhoutong Zhang , Forrester Cole , Richard Tucker , William T. Freeman , Tali Dekel

Scene flow provides crucial motion information for autonomous driving. Recent LiDAR scene flow models utilize the rigid-motion assumption at the instance level, assuming objects are rigid bodies. However, these instance-level methods are…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jialong Wu , Marco Braun , Dominic Spata , Matthias Rottmann
‹ Prev 1 2 3 10 Next ›