English
Related papers

Related papers: FlowNet3D++: Geometric Losses For Deep Scene Flow …

200 papers

Optical flow estimation is a fundamental task in computer vision. Recent direct-regression methods using deep neural networks achieve remarkable performance improvement. However, they do not explicitly capture long-term motion…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Shiyu Zhao , Long Zhao , Zhixing Zhang , Enyu Zhou , Dimitris Metaxas

Scene flow estimation aims to generate the 3D motion field of points between two consecutive frames of point clouds, which has wide applications in various fields. Existing point-based methods ignore the irregularity of point clouds and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Xuezhi Xiang , Xi Wang , Lei Zhang , Denis Ombati , Himaloy Himu , Xiantong Zhen

3D geometry is a very informative cue when interacting with and navigating an environment. This writing proposes a new approach to 3D reconstruction and scene understanding, which implicitly learns 3D geometry from depth maps pairing a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Dario Rethage , Federico Tombari , Felix Achilles , Nassir Navab

Deep neural networks have made significant advancements in accurately estimating scene flow using point clouds, which is vital for many applications like video analysis, action recognition, and navigation. The robustness of these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Haniyeh Ehsani Oskouie , Mohammad-Shahram Moin , Shohreh Kasaei

Scene flow is the task of estimating 3D motion vectors to individual points of a dynamic 3D scene. Motion vectors have shown to be beneficial for downstream tasks such as action classification and collision avoidance. However, data…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Victor Zuanazzi

Real-time open-vocabulary scene understanding is essential for efficient 3D perception in applications such as vision-language navigation, embodied intelligence, and augmented reality. However, existing methods suffer from imprecise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Xiaofeng Jin , Matteo Frosi , Matteo Matteucci

The precise reconstruction of 3D objects from a single RGB image in complex scenes presents a critical challenge in virtual reality, autonomous driving, and robotics. Existing neural implicit 3D representation methods face significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Luoxi Zhang , Pragyan Shrestha , Yu Zhou , Chun Xie , Itaru Kitahara

Occlusions hinder point cloud frame alignment in LiDAR data, a challenge inadequately addressed by scene flow models tested mainly on occlusion-free datasets. Attempts to integrate occlusion handling within networks often suffer accuracy…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Jingze Chen , Junfeng Yao , Qiqin Lin , Lei Li

We propose a continuous optimization method for solving dense 3D scene flow problems from stereo imagery. As in recent work, we represent the dynamic 3D scene as a collection of rigidly moving planar segments. The scene flow problem then…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Zhaoyang Lv , Chris Beall , Pablo F. Alcantarilla , Fuxin Li , Zsolt Kira , Frank Dellaert

Most end-to-end Multi-Object Tracking (MOT) methods face the problems of low accuracy and poor generalization ability. Although traditional filter-based methods can achieve better results, they are difficult to be endowed with optimal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Guangyao Zhai , Xin Kong , Jinhao Cui , Yong Liu , Zhen Yang

Understanding the motion states of the surrounding environment is critical for safe autonomous driving. These motion states can be accurately derived from scene flow, which captures the three-dimensional motion field of points. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jaeyeul Kim , Jungwan Woo , Ukcheol Shin , Jean Oh , Sunghoon Im

FlowNet2, the state-of-the-art convolutional neural network (CNN) for optical flow estimation, requires over 160M parameters to achieve accurate flow estimation. In this paper we present an alternative network that outperforms FlowNet2 on…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Tak-Wai Hui , Xiaoou Tang , Chen Change Loy

Perceiving and understanding 3D motion is a core technology in fields such as autonomous driving, robots, and motion prediction. This paper proposes a 3D motion perception method called ScaleFlow++ that is easy to generalize. With just a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Han Ling , Yinghui Sun , Quansen Sun , Yuhui Zheng

Perceiving and understanding 3D motion is a core technology in fields such as autonomous driving, robots, and motion prediction. This paper proposes a 3D motion perception method called ScaleFlow++ that is easy to generalize. With just a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Han Ling , Quansen Sun

Optical flow computation is essential in the early stages of the video processing pipeline. This paper focuses on a less explored problem in this area, the 360$^\circ$ optical flow estimation using deep neural networks to support…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Yiheng Li , Connelly Barnes , Kun Huang , Fang-Lue Zhang

Previous dominant methods for scene flow estimation focus mainly on input from two consecutive frames, neglecting valuable information in the temporal domain. While recent trends shift towards multi-frame reasoning, they suffer from rapidly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Qingwen Zhang , Xiaomeng Zhu , Yushan Zhang , Yixi Cai , Olov Andersson , Patric Jensfelt

Deep learning approaches have achieved great success in addressing the problem of optical flow estimation. The keys to success lie in the use of cost volume and coarse-to-fine flow inference. However, the matching problem becomes ill-posed…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Tak-Wai Hui , Chen Change Loy

Simulating fluid flow around arbitrary shapes is key to solving various engineering problems. However, simulating flow physics across complex geometries remains numerically challenging and computationally resource-intensive, particularly…

Autonomous vehicles operate in highly dynamic environments necessitating an accurate assessment of which aspects of a scene are moving and where they are moving to. A popular approach to 3D motion estimation, termed scene flow, is to employ…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Philipp Jund , Chris Sweeney , Nichola Abdo , Zhifeng Chen , Jonathon Shlens

Event cameras offer promising properties, such as high temporal resolution and high dynamic range. These benefits have been utilized into many machine vision tasks, especially optical flow estimation. Currently, most existing event-based…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Hao Zhuang , Xinjie Huang , Kuanxu Hou , Delei Kong , Chenming Hu , Zheng Fang