English
Related papers

Related papers: OptFlow: Fast Optimization-based Scene Flow Estima…

200 papers

3D scene flow estimation aims to estimate point-wise motions between two consecutive frames of point clouds. Superpoints, i.e., points with similar geometric features, are usually employed to capture similar motions of local regions in 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Yaqi Shen , Le Hui , Jin Xie , Jian Yang

Scene flow allows autonomous vehicles to reason about the arbitrary motion of multiple independent objects which is the key to long-term mobile autonomy. While estimating the scene flow from LiDAR has progressed recently, it remains largely…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Fangqiang Ding , Zhijun Pan , Yimin Deng , Jianning Deng , Chris Xiaoxuan Lu

Scene flow estimation determines a scene's 3D motion field, by predicting the motion of points in the scene, especially for aiding tasks in autonomous driving. Many networks with large-scale point clouds as input use voxelization to create…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Qingwen Zhang , Yi Yang , Heng Fang , Ruoyu Geng , Patric Jensfelt

The interpretation of ego motion and scene change is a fundamental task for mobile robots. Optical flow information can be employed to estimate motion in the surroundings. Recently, unsupervised optical flow estimation has become a research…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Hengli Wang , Rui Fan , Ming Liu

Scene flow characterizes the 3D motion between two LiDAR scans captured by an autonomous vehicle at nearby timesteps. Prevalent methods consider scene flow as point-wise unconstrained flow vectors that can be learned by either large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yancong Lin , Holger Caesar

Motion detection is a fundamental but challenging task for autonomous driving. In particular scenes like highway, remote objects have to be paid extra attention for better controlling decision. Aiming at distant vehicles, we train a neural…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Ka Man Lo

3D scene flow estimation from point clouds is a low-level 3D motion perception task in computer vision. Flow embedding is a commonly used technique in scene flow estimation, and it encodes the point motion between two consecutive frames.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Guangming Wang , Yunzhe Hu , Zhe Liu , Yiyang Zhou , Masayoshi Tomizuka , Wei Zhan , Hesheng Wang

Optical Flow (OF) is the movement pattern of pixels or edges that is caused in a visual scene by the relative motion between an agent and a scene. OF is used in a wide range of computer vision algorithms and robotics applications. While the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Jonas Kühne , Michele Magno , Luca Benini

We tackle the problem of estimating optical flow from a monocular camera in the context of autonomous driving. We build on the observation that the scene is typically composed of a static background, as well as a relatively small number of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Min Bai , Wenjie Luo , Kaustav Kundu , Raquel Urtasun

Gathering data and identifying events in various traffic situations remains an essential challenge for the systematic evaluation of a perception system's performance. Analyzing large-scale, typically unstructured, multi-modal, time series…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Tayssir Bouraffa , Elias Kjellberg Carlson , Erik Wessman , Ali Nouri , Pierre Lamart , Christian Berger

3D motion estimation including scene flow and point cloud registration has drawn increasing interest. Inspired by 2D flow estimation, recent methods employ deep neural networks to construct the cost volume for estimating accurate 3D flow.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Xiaodong Gu , Chengzhou Tang , Weihao Yuan , Zuozhuo Dai , Siyu Zhu , Ping Tan

Autonomous vehicle navigation is a key challenge in artificial intelligence, requiring robust and accurate decision-making processes. This research introduces a new end-to-end method that exploits multimodal information from a single…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Fouad Makiyeh , Mark Bastourous , Anass Bairouk , Wei Xiao , Mirjana Maras , Tsun-Hsuan Wangb , Marc Blanchon , Ramin Hasani , Patrick Chareyre , Daniela Rus

Scene flow estimation is the task of describing the 3D motion field between temporally successive point clouds. State-of-the-art methods use strong priors and test-time optimization techniques, but require on the order of tens of seconds to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Kyle Vedder , Neehar Peri , Nathaniel Chodosh , Ishan Khatri , Eric Eaton , Dinesh Jayaraman , Yang Liu , Deva Ramanan , James Hays

Synthetic datasets play a critical role in pre-training CNN models for optical flow, but they are painstaking to generate and hard to adapt to new applications. To automate the process, we present AutoFlow, a simple and effective method to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Deqing Sun , Daniel Vlasic , Charles Herrmann , Varun Jampani , Michael Krainin , Huiwen Chang , Ramin Zabih , William T. Freeman , Ce Liu

Significant attention has been attracted to deep learning-based depth estimates. Dynamic objects become the most hard problems in inter-frame-supervised depth estimates due to the uncertainty in adjacent frames. Thus, integrating optical…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Zhengyang Lu , Ying Chen

In the domain of supervised scene flow estimation, the process of manual labeling is both time-intensive and financially demanding. This paper introduces SSFlowNet, a semi-supervised approach for scene flow estimation, that utilizes a blend…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jingze Chen , Junfeng Yao , Qiqin Lin , Rongzhou Zhou , Lei Li

Scene flow estimation, which aims to predict per-point 3D displacements of dynamic scenes, is a fundamental task in the computer vision field. However, previous works commonly suffer from unreliable correlation caused by locally constrained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Jiuming Liu , Guangming Wang , Weicai Ye , Chaokang Jiang , Jinru Han , Zhe Liu , Guofeng Zhang , Dalong Du , Hesheng Wang

CNN-based optical flow estimation has attracted attention recently, mainly due to its impressively high frame rates. These networks perform well on synthetic datasets, but they are still far behind the classical methods in real-world…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Nima Sedaghat , Mohammadreza Zolfaghari , Thomas Brox

We present DDFlow, a data distillation approach to learning optical flow estimation from unlabeled data. The approach distills reliable predictions from a teacher network, and uses these predictions as annotations to guide a student network…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Pengpeng Liu , Irwin King , Michael R. Lyu , Jia Xu

Optical flow estimation is one of the fundamental tasks in low-level computer vision, which describes the pixel-wise displacement and can be used in many other tasks. From the apparent aspect, the optical flow can be viewed as the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Yuhao Cheng , Siru Zhang , Yiqiang Yan