English
Related papers

Related papers: SCOOP: Self-Supervised Correspondence and Optimiza…

200 papers

We propose a novel end-to-end deep scene flow model, called PointPWC-Net, on 3D point clouds in a coarse-to-fine fashion. Flow computed at the coarse level is upsampled and warped to a finer level, enabling the algorithm to accommodate for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Wenxuan Wu , Zhiyuan Wang , Zhuwen Li , Wei Liu , Li Fuxin

Understanding the flow in 3D space of sparsely sampled points between two consecutive time frames is the core stone of modern geometric-driven systems such as VR/AR, Robotics, and Autonomous driving. The lack of real, non-simulated, labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Bojun Ouyang , Dan Raviv

Scene flow estimation determines a scene's 3D motion field, by predicting the motion of points in the scene, especially for aiding tasks in autonomous driving. Many networks with large-scale point clouds as input use voxelization to create…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Qingwen Zhang , Yi Yang , Heng Fang , Ruoyu Geng , Patric Jensfelt

We propose a data-driven scene flow estimation algorithm exploiting the observation that many 3D scenes can be explained by a collection of agents moving as rigid bodies. At the core of our method lies a deep architecture able to reason at…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Zan Gojcic , Or Litany , Andreas Wieser , Leonidas J. Guibas , Tolga Birdal

Efficiently selecting an appropriate spike stream data length to extract precise information is the key to the spike vision tasks. To address this issue, we propose a dynamic timing representation for spike streams. Based on multi-layers…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Lujie Xia , Ziluo Ding , Rui Zhao , Jiyuan Zhang , Lei Ma , Zhaofei Yu , Tiejun Huang , Ruiqin Xiong

Learning scene flow from a monocular camera still remains a challenging task due to its ill-posedness as well as lack of annotated data. Self-supervised methods demonstrate learning scene flow estimation from unlabeled data, yet their…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Bayram Bayramli , Junhwa Hur , Hongtao Lu

Low-resolution point clouds are challenging for object detection methods due to their sparsity. Densifying the present point cloud by concatenating it with its predecessors is a popular solution to this challenge. Such concatenation is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Minh-Quan Dao , Vincent Frémont , Elwan Héry

We propose a continuous optimization method for solving dense 3D scene flow problems from stereo imagery. As in recent work, we represent the dynamic 3D scene as a collection of rigidly moving planar segments. The scene flow problem then…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Zhaoyang Lv , Chris Beall , Pablo F. Alcantarilla , Fuxin Li , Zsolt Kira , Frank Dellaert

Scene flow is a powerful tool for capturing the motion field of 3D point clouds. However, it is difficult to directly apply flow-based models to dynamic point cloud classification since the unstructured points make it hard or even…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Jia-Xing Zhong , Kaichen Zhou , Qingyong Hu , Bing Wang , Niki Trigoni , Andrew Markham

Despite significant progress in image-based 3D scene flow estimation, the performance of such approaches has not yet reached the fidelity required by many applications. Simultaneously, these applications are often not restricted to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Aseem Behl , Despoina Paschalidou , Simon Donné , Andreas Geiger

Multi-beam LiDAR sensors, as used on autonomous vehicles and mobile robots, acquire sequences of 3D range scans ("frames"). Each frame covers the scene sparsely, due to limited angular scanning resolution and occlusion. The sparsity…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Shengyu Huang , Zan Gojcic , Jiahui Huang , Andreas Wieser , Konrad Schindler

Scene flow estimation, which aims to predict per-point 3D displacements of dynamic scenes, is a fundamental task in the computer vision field. However, previous works commonly suffer from unreliable correlation caused by locally constrained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Jiuming Liu , Guangming Wang , Weicai Ye , Chaokang Jiang , Jinru Han , Zhe Liu , Guofeng Zhang , Dalong Du , Hesheng Wang

Scene flow prediction is a crucial underlying task in understanding dynamic scenes as it offers fundamental motion information. However, contemporary scene flow methods encounter three major challenges. Firstly, flow estimation solely based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Zhiyang Lu , Qinghan Chen , Ming Cheng

This paper is the first to review the scene flow estimation field, which analyzes and compares methods, technical challenges, evaluation methodologies and performance of scene flow estimation. Existing algorithms are categorized in terms of…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Zike Yan , Xuezhi Xiang

The task of point cloud upsampling aims to acquire dense and uniform point sets from sparse and irregular point sets. Although significant progress has been made with deep learning models, state-of-the-art methods require ground-truth dense…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Xinhai Liu , Xinchen Liu , Yu-Shen Liu , Zhizhong Han

In the field of 3D scene understanding, 3D scene graphs have emerged as a new scene representation that combines geometric and semantic information about objects and their relationships. However, learning semantic 3D scene graphs in a fully…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Sebastian Koch , Pedro Hermosilla , Narunas Vaskevicius , Mirco Colosi , Timo Ropinski

State-of-the-art scene flow algorithms pursue the conflicting targets of accuracy, run time, and robustness. With the successful concept of pixel-wise matching and sparse-to-dense interpolation, we push the limits of scene flow estimation.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 René Schuster , Oliver Wasenmüller , Christian Unger , Georg Kuschk , Didier Stricker

Scene flow estimation is an extremely important task in computer vision to support the perception of dynamic changes in the scene. For robust scene flow, learning-based approaches have recently achieved impressive results using either…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Rajai Alhimdiat , Ramy Battrawy , René Schuster , Didier Stricker , Wesam Ashour

Learning 3D scene flow from LiDAR point clouds presents significant difficulties, including poor generalization from synthetic datasets to real scenes, scarcity of real-world 3D labels, and poor performance on real sparse LiDAR point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Chaokang Jiang , Guangming Wang , Jiuming Liu , Hesheng Wang , Zhuang Ma , Zhenqiang Liu , Zhujin Liang , Yi Shan , Dalong Du

Existing work on scene flow estimation focuses on autonomous driving and mobile robotics, while automated solutions are lacking for motion in nature, such as that exhibited by debris flows. We propose DEFLOW, a model for 3D motion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Liyuan Zhu , Yuru Jia , Shengyu Huang , Nicholas Meyer , Andreas Wieser , Konrad Schindler , Jordan Aaron