English
Related papers

Related papers: Regularizing Self-supervised 3D Scene Flows with S…

200 papers

Learning 3D scene flow from LiDAR point clouds presents significant difficulties, including poor generalization from synthetic datasets to real scenes, scarcity of real-world 3D labels, and poor performance on real sparse LiDAR point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Chaokang Jiang , Guangming Wang , Jiuming Liu , Hesheng Wang , Zhuang Ma , Zhenqiang Liu , Zhujin Liang , Yi Shan , Dalong Du

Estimating continuous optical flow is a fundamental yet challenging problem in dynamic visual perception. Event-based cameras, with microsecond latency and high dynamic range, capture brightness changes asynchronously, offering a unique…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Rui Hu , Song Wu , Wen Yang , Jinjian Wu

As 3D point clouds become the representation of choice for multiple vision and graphics applications, the ability to synthesize or reconstruct high-resolution, high-fidelity point clouds becomes crucial. Despite the recent success of deep…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Guandao Yang , Xun Huang , Zekun Hao , Ming-Yu Liu , Serge Belongie , Bharath Hariharan

In this paper, we deal with the problem to predict the future 3D motions of 3D object scans from previous two consecutive frames. Previous methods mostly focus on sparse motion prediction in the form of skeletons. While in this paper we…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Shuaihang Yuan , Xiang Li , Anthony Tzes , Yi Fang

Scene flow estimation aims to recover per-point motion from two adjacent LiDAR scans. However, in real-world applications such as autonomous driving, points rarely move independently of others, especially for nearby points belonging to the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yancong Lin , Shiming Wang , Liangliang Nan , Julian Kooij , Holger Caesar

Current successful methods of 3D scene perception rely on the large-scale annotated point cloud, which is tedious and expensive to acquire. In this paper, we propose Model2Scene, a novel paradigm that learns free 3D scene representation…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Runnan Chen , Xinge Zhu , Nenglun Chen , Dawei Wang , Wei Li , Yuexin Ma , Ruigang Yang , Tongliang Liu , Wenping Wang

We present a novel deep learning framework for flow field predictions in irregular domains when the solution is a function of the geometry of either the domain or objects inside the domain. Grid vertices in a computational fluid dynamics…

Machine Learning · Computer Science 2021-09-20 Ali Kashefi , Davis Rempe , Leonidas J. Guibas

We propose a novel end-to-end deep scene flow model, called PointPWC-Net, on 3D point clouds in a coarse-to-fine fashion. Flow computed at the coarse level is upsampled and warped to a finer level, enabling the algorithm to accommodate for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Wenxuan Wu , Zhiyuan Wang , Zhuwen Li , Wei Liu , Li Fuxin

In the domain of supervised scene flow estimation, the process of manual labeling is both time-intensive and financially demanding. This paper introduces SSFlowNet, a semi-supervised approach for scene flow estimation, that utilizes a blend…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jingze Chen , Junfeng Yao , Qiqin Lin , Rongzhou Zhou , Lei Li

The test-time optimization of scene flow - using a coordinate network as a neural prior - has gained popularity due to its simplicity, lack of dataset bias, and state-of-the-art performance. We observe, however, that although coordinate…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Kavisha Vidanapathirana , Shin-Fang Chng , Xueqian Li , Simon Lucey

Recently normalizing flows (NFs) have demonstrated state-of-the-art performance on modeling 3D point clouds while allowing sampling with arbitrary resolution at inference time. However, these flow-based models still require long training…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Janis Postels , Mengya Liu , Riccardo Spezialetti , Luc Van Gool , Federico Tombari

Existing state-of-the-art 3D point clouds understanding methods only perform well in a fully supervised manner. To the best of our knowledge, there exists no unified framework which simultaneously solves the downstream high-level…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Kangcheng Liu

Scene flow estimation aims to generate the 3D motion field of points between two consecutive frames of point clouds, which has wide applications in various fields. Existing point-based methods ignore the irregularity of point clouds and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Xuezhi Xiang , Xi Wang , Lei Zhang , Denis Ombati , Himaloy Himu , Xiantong Zhen

Neural Scene Flow Prior (NSFP) and Fast Neural Scene Flow (FNSF) have shown remarkable adaptability in the context of large out-of-distribution autonomous driving. Despite their success, the underlying reasons for their astonishing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Dongrui Liu , Daqi Liu , Xueqian Li , Sihao Lin , Hongwei xie , Bing Wang , Xiaojun Chang , Lei Chu

Point cloud registration aligns multiple unposed point clouds into a common reference frame and is a core step for 3D reconstruction and robot localization without initial guess. In this work, we cast registration as conditional generation:…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yue Pan , Tao Sun , Liyuan Zhu , Lucas Nunes , Iro Armeni , Jens Behley , Cyrill Stachniss

Most recent unsupervised non-rigid 3D shape matching methods are based on the functional map framework due to its efficiency and superior performance. Nevertheless, respective methods struggle to obtain spatially smooth pointwise…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Dongliang Cao , Zorah Laehner , Florian Bernard

We present a self-supervised approach to estimate flow in camera image and top-view grid map sequences using fully convolutional neural networks in the domain of automated driving. We extend existing approaches for self-supervised optical…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Sascha Wirges , Johannes Gräter , Qiuhao Zhang , Christoph Stiller

Self-supervised monocular depth estimation enables robots to learn 3D perception from raw video streams. This scalable approach leverages projective geometry and ego-motion to learn via view synthesis, assuming the world is mostly static.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Kuan-Hui Lee , Rares Ambrus , Adrien Gaidon

Flow-based generative models are composed of invertible transformations between two random variables of the same dimension. Therefore, flow-based models cannot be adequately trained if the dimension of the data distribution does not match…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Hyeongju Kim , Hyeonseung Lee , Woo Hyun Kang , Joun Yeop Lee , Nam Soo Kim

Recent advancements in camera-based occupancy prediction have focused on the simultaneous prediction of 3D semantics and scene flow, a task that presents significant challenges due to specific difficulties, e.g., occlusions and unbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ziyue Zhu , Shenlong Wang , Jin Xie , Jiang-jiang Liu , Jingdong Wang , Jian Yang