English
Related papers

Related papers: Self-Supervised 3D Scene Flow Estimation Guided by…

200 papers

3D point cloud semantic segmentation is a challenging topic in the computer vision field. Most of the existing methods in literature require a large amount of fully labeled training data, but it is extremely time-consuming to obtain these…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Shuang Deng , Qiulei Dong , Bo Liu , Zhanyi Hu

Point clouds are naturally sparse, while image pixels are dense. The inconsistency limits feature fusion from both modalities for point-wise scene flow estimation. Previous methods rarely predict scene flow from the entire point clouds of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Chensheng Peng , Guangming Wang , Xian Wan Lo , Xinrui Wu , Chenfeng Xu , Masayoshi Tomizuka , Wei Zhan , Hesheng Wang

Understanding 3D scenes is a critical prerequisite for autonomous agents. Recently, LiDAR and other sensors have made large amounts of data available in the form of temporal sequences of point cloud frames. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Pan He , Patrick Emami , Sanjay Ranka , Anand Rangarajan

Scene flow represents the 3D motion of each point in the scene, which explicitly describes the distance and the direction of each point's movement. Scene flow estimation is used in various applications such as autonomous driving fields,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Guangming Wang , Zhiheng Feng , Chaokang Jiang , Hesheng Wang

In the domain of supervised scene flow estimation, the process of manual labeling is both time-intensive and financially demanding. This paper introduces SSFlowNet, a semi-supervised approach for scene flow estimation, that utilizes a blend…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jingze Chen , Junfeng Yao , Qiqin Lin , Rongzhou Zhou , Lei Li

Estimating the 3D motion of points in a scene, known as scene flow, is a core problem in computer vision. Traditional learning-based methods designed to learn end-to-end 3D flow often suffer from poor generalization. Here we present a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yair Kittenplon , Yonina C. Eldar , Dan Raviv

Despite significant progress in image-based 3D scene flow estimation, the performance of such approaches has not yet reached the fidelity required by many applications. Simultaneously, these applications are often not restricted to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Aseem Behl , Despoina Paschalidou , Simon Donné , Andreas Geiger

Scene flow allows autonomous vehicles to reason about the arbitrary motion of multiple independent objects which is the key to long-term mobile autonomy. While estimating the scene flow from LiDAR has progressed recently, it remains largely…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Fangqiang Ding , Zhijun Pan , Yimin Deng , Jianning Deng , Chris Xiaoxuan Lu

Scene flow estimation has been receiving increasing attention for 3D environment perception. Monocular scene flow estimation -- obtaining 3D structure and 3D motion from two temporally consecutive images -- is a highly ill-posed problem,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Junhwa Hur , Stefan Roth

As 3D point clouds become the representation of choice for multiple vision and graphics applications, the ability to synthesize or reconstruct high-resolution, high-fidelity point clouds becomes crucial. Despite the recent success of deep…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Guandao Yang , Xun Huang , Zekun Hao , Ming-Yu Liu , Serge Belongie , Bharath Hariharan

Scene flow is the task of estimating 3D motion vectors to individual points of a dynamic 3D scene. Motion vectors have shown to be beneficial for downstream tasks such as action classification and collision avoidance. However, data…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Victor Zuanazzi

We propose a novel scene flow method that captures 3D motions from point clouds without relying on ground-truth scene flow annotations. Due to the irregularity and sparsity of point clouds, it is expensive and time-consuming to acquire…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Bing Li , Cheng Zheng , Guohao Li , Bernard Ghanem

Most of the current scene flow methods choose to model scene flow as a per point translation vector without differentiating between static and dynamic components of 3D motion. In this work we present an alternative method for end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Ivan Tishchenko , Sandro Lombardi , Martin R. Oswald , Marc Pollefeys

Learning 3D scene flow from LiDAR point clouds presents significant difficulties, including poor generalization from synthetic datasets to real scenes, scarcity of real-world 3D labels, and poor performance on real sparse LiDAR point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Chaokang Jiang , Guangming Wang , Jiuming Liu , Hesheng Wang , Zhuang Ma , Zhenqiang Liu , Zhujin Liang , Yi Shan , Dalong Du

Scene flow depicts the dynamics of a 3D scene, which is critical for various applications such as autonomous driving, robot navigation, AR/VR, etc. Conventionally, scene flow is estimated from dense/regular RGB video frames. With the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Haiyan Wang , Jiahao Pang , Muhammad A. Lodhi , Yingli Tian , Dong Tian

We propose a novel scene flow estimation approach to capture and infer 3D motions from point clouds. Estimating 3D motions for point clouds is challenging, since a point cloud is unordered and its density is significantly non-uniform. Such…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Bing Li , Cheng Zheng , Silvio Giancola , Bernard Ghanem

Learning without supervision how to predict 3D scene flows from point clouds is essential to many perception systems. We propose a novel learning framework for this task which improves the necessary regularization. Relying on the assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Patrik Vacek , David Hurych , Karel Zimmermann , Patrick Perez , Tomas Svoboda

We propose a novel end-to-end deep scene flow model, called PointPWC-Net, on 3D point clouds in a coarse-to-fine fashion. Flow computed at the coarse level is upsampled and warped to a finer level, enabling the algorithm to accommodate for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Wenxuan Wu , Zhiyuan Wang , Zhuwen Li , Wei Liu , Li Fuxin

3D scene flow estimation is a vital tool in perceiving our environment given depth or range sensors. Unlike optical flow, the data is usually sparse and in most cases partially occluded in between two temporal samplings. Here we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Bojun Ouyang , Dan Raviv

The proposed RMS-FlowNet is a novel end-to-end learning-based architecture for accurate and efficient scene flow estimation which can operate on point clouds of high density. For hierarchical scene flow estimation, the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Ramy Battrawy , René Schuster , Mohammad-Ali Nikouei Mahani , Didier Stricker