中文
相关论文

相关论文: Self-Supervised Multi-Frame Neural Scene Flow

200 篇论文

Recently, neural network for scene flow estimation show impressive results on automotive data such as the KITTI benchmark. However, despite of using sophisticated rigidity assumptions and parametrizations, such networks are typically…

计算机视觉与模式识别 · 计算机科学 2022-10-31 Lukas Mehl , Azin Jahedi , Jenny Schmalfuss , Andrés Bruhn

3D scene flow estimation is a vital tool in perceiving our environment given depth or range sensors. Unlike optical flow, the data is usually sparse and in most cases partially occluded in between two temporal samplings. Here we propose a…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Bojun Ouyang , Dan Raviv

In this paper, we present a new self-supervised scene flow estimation approach for a pair of consecutive point clouds. The key idea of our approach is to represent discrete point clouds as continuous probability density functions using…

计算机视觉与模式识别 · 计算机科学 2022-03-24 Pan He , Patrick Emami , Sanjay Ranka , Anand Rangarajan

Scene flow estimation determines a scene's 3D motion field, by predicting the motion of points in the scene, especially for aiding tasks in autonomous driving. Many networks with large-scale point clouds as input use voxelization to create…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Qingwen Zhang , Yi Yang , Heng Fang , Ruoyu Geng , Patric Jensfelt

It is important to estimate an accurate signed distance function (SDF) from a point cloud in many computer vision applications. The latest methods learn neural SDFs using either a data-driven based or an overfitting-based strategy. However,…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Chao Chen , Yu-Shen Liu , Zhizhong Han

High-fidelity 3D scene reconstruction has been substantially advanced by recent progress in neural fields. However, most existing methods train a separate network from scratch for each individual scene. This is not scalable, inefficient,…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Yang Fu , Shalini De Mello , Xueting Li , Amey Kulkarni , Jan Kautz , Xiaolong Wang , Sifei Liu

Point cloud sequences are commonly used to accurately detect 3D objects in applications such as autonomous driving. Current top-performing multi-frame detectors mostly follow a Detect-and-Fuse framework, which extracts features from each…

计算机视觉与模式识别 · 计算机科学 2023-03-16 Chenhang He , Ruihuang Li , Yabin Zhang , Shuai Li , Lei Zhang

Due to the scarcity of annotated scene flow data, self-supervised scene flow learning in point clouds has attracted increasing attention. In the self-supervised manner, establishing correspondences between two point clouds to approximate…

计算机视觉与模式识别 · 计算机科学 2021-05-19 Ruibo Li , Guosheng Lin , Lihua Xie

Scene flow in 3D point clouds plays an important role in understanding dynamic environments. Although significant advances have been made by deep neural networks, the performance is far from satisfactory as only per-point translational…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Ruibo Li , Guosheng Lin , Tong He , Fayao Liu , Chunhua Shen

Autonomous vehicle navigation is a key challenge in artificial intelligence, requiring robust and accurate decision-making processes. This research introduces a new end-to-end method that exploits multimodal information from a single…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Fouad Makiyeh , Mark Bastourous , Anass Bairouk , Wei Xiao , Mirjana Maras , Tsun-Hsuan Wangb , Marc Blanchon , Ramin Hasani , Patrick Chareyre , Daniela Rus

We reframe scene flow as the task of estimating a continuous space-time ODE that describes motion for an entire observation sequence, represented with a neural prior. Our method, EulerFlow, optimizes this neural prior estimate against…

计算机视觉与模式识别 · 计算机科学 2025-12-08 Kyle Vedder , Neehar Peri , Ishan Khatri , Siyi Li , Eric Eaton , Mehmet Kocamaz , Yue Wang , Zhiding Yu , Deva Ramanan , Joachim Pehserl

We study the problem of self-supervised 3D scene flow estimation from real large-scale raw point cloud sequences, which is crucial to various tasks like trajectory prediction or instance segmentation. In the absence of ground truth scene…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Patrik Vacek , David Hurych , Tomáš Svoboda , Karel Zimmermann

Point clouds are naturally sparse, while image pixels are dense. The inconsistency limits feature fusion from both modalities for point-wise scene flow estimation. Previous methods rarely predict scene flow from the entire point clouds of…

计算机视觉与模式识别 · 计算机科学 2023-08-10 Chensheng Peng , Guangming Wang , Xian Wan Lo , Xinrui Wu , Chenfeng Xu , Masayoshi Tomizuka , Wei Zhan , Hesheng Wang

Scene flow estimation has been receiving increasing attention for 3D environment perception. Monocular scene flow estimation -- obtaining 3D structure and 3D motion from two temporally consecutive images -- is a highly ill-posed problem,…

计算机视觉与模式识别 · 计算机科学 2020-04-17 Junhwa Hur , Stefan Roth

When interacting with highly dynamic environments, scene flow allows autonomous systems to reason about the non-rigid motion of multiple independent objects. This is of particular interest in the field of autonomous driving, in which many…

计算机视觉与模式识别 · 计算机科学 2020-04-15 Himangi Mittal , Brian Okorn , David Held

Estimating 3D scene flow from a sequence of monocular images has been gaining increased attention due to the simple, economical capture setup. Owing to the severe ill-posedness of the problem, the accuracy of current methods has been…

计算机视觉与模式识别 · 计算机科学 2021-05-06 Junhwa Hur , Stefan Roth

We present a self-supervised approach to estimate flow in camera image and top-view grid map sequences using fully convolutional neural networks in the domain of automated driving. We extend existing approaches for self-supervised optical…

计算机视觉与模式识别 · 计算机科学 2019-04-30 Sascha Wirges , Johannes Gräter , Qiuhao Zhang , Christoph Stiller

To date, top-performing optical flow estimation methods only take pairs of consecutive frames into account. While elegant and appealing, the idea of using more than two frames has not yet produced state-of-the-art results. We present a…

计算机视觉与模式识别 · 计算机科学 2018-11-30 Zhile Ren , Orazio Gallo , Deqing Sun , Ming-Hsuan Yang , Erik B. Sudderth , Jan Kautz

Learning scene flow from a monocular camera still remains a challenging task due to its ill-posedness as well as lack of annotated data. Self-supervised methods demonstrate learning scene flow estimation from unlabeled data, yet their…

计算机视觉与模式识别 · 计算机科学 2022-05-04 Bayram Bayramli , Junhwa Hur , Hongtao Lu

Scene flow estimation is the task to predict the point-wise or pixel-wise 3D displacement vector between two consecutive frames of point clouds or images, which has important application in fields such as service robots and autonomous…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Guangming Wang , Yunzhe Hu , Xinrui Wu , Hesheng Wang