English
Related papers

Related papers: Adversarial Self-Supervised Scene Flow Estimation

200 papers

3D single object tracking (SOT) is a crucial task in fields of mobile robotics and autonomous driving. Traditional motion-based approaches achieve target tracking by estimating the relative movement of target between two consecutive frames.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Shuo Li , Yubo Cui , Zhiheng Li , Zheng Fang

We present an unsupervised learning framework for simultaneously training single-view depth prediction and optical flow estimation models using unlabeled video sequences. Existing unsupervised methods often exploit brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Yuliang Zou , Zelun Luo , Jia-Bin Huang

Due to the difficulty of obtaining ground-truth data for 4D radar scene flow estimation, previous methods typically rely on either self-supervised losses or cross-modal supervision using 3D LiDAR data, 2D images, and odometry. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Jingyun Fu , Zhiyu Xiang , Na Zhao

Scene flow estimation determines a scene's 3D motion field, by predicting the motion of points in the scene, especially for aiding tasks in autonomous driving. Many networks with large-scale point clouds as input use voxelization to create…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Qingwen Zhang , Yi Yang , Heng Fang , Ruoyu Geng , Patric Jensfelt

Existing work on scene flow estimation focuses on autonomous driving and mobile robotics, while automated solutions are lacking for motion in nature, such as that exhibited by debris flows. We propose DEFLOW, a model for 3D motion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Liyuan Zhu , Yuru Jia , Shengyu Huang , Nicholas Meyer , Andreas Wieser , Konrad Schindler , Jordan Aaron

Most self-supervised 6D object pose estimation methods can only work with additional depth information or rely on the accurate annotation of 2D segmentation masks, limiting their application range. In this paper, we propose a 6D object pose…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yang Hai , Rui Song , Jiaojiao Li , David Ferstl , Yinlin Hu

For visual estimation of optical flow, a crucial function for many vision tasks, unsupervised learning, using the supervision of view synthesis has emerged as a promising alternative to supervised methods, since ground-truth flow is not…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zitang Sun , Shin'ya Nishida , Zhengbo Luo

Point clouds provide a compact and efficient representation of 3D shapes. While deep neural networks have achieved impressive results on point cloud learning tasks, they require massive amounts of manually labeled data, which can be costly…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Omid Poursaeed , Tianxing Jiang , Han Qiao , Nayun Xu , Vladimir G. Kim

Scene flow is a challenging task aimed at jointly estimating the 3D structure and motion of the sensed environment. Although deep learning solutions achieve outstanding performance in terms of accuracy, these approaches divide the whole…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Filippo Aleotti , Matteo Poggi , Fabio Tosi , Stefano Mattoccia

3D Multi-Object Tracking (MOT) is an important part of the unmanned vehicle perception module. Most methods optimize object detection and data association independently. These methods make the network structure complicated and limit the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Yueling Shen , Guangming Wang , Hesheng Wang

An efficient 3D scene flow estimation method called PointFlowHop is proposed in this work. PointFlowHop takes two consecutive point clouds and determines the 3D flow vectors for every point in the first point cloud. PointFlowHop decomposes…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Pranav Kadam , Jiahao Gu , Shan Liu , C. -C. Jay Kuo

Unsupervised optical flow estimators based on deep learning have attracted increasing attention due to the cost and difficulty of annotating for ground truth. Although performance measured by average End-Point Error (EPE) has improved over…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Shuzhi Yu , Hannah Halin Kim , Shuai Yuan , Carlo Tomasi

Point cloud scene flow estimation is of practical importance for dynamic scene navigation in autonomous driving. Since scene flow labels are hard to obtain, current methods train their models on synthetic data and transfer them to real…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Zhao Jin , Yinjie Lei , Naveed Akhtar , Haifeng Li , Munawar Hayat

We introduce a way to learn to estimate a scene representation from a single image by predicting a low-dimensional subspace of optical flow for each training example, which encompasses the variety of possible camera and object movement.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Richard Strong Bowen , Richard Tucker , Ramin Zabih , Noah Snavely

Self-supervised learning has transformed 2D computer vision by enabling models trained on large, unannotated datasets to provide versatile off-the-shelf features that perform similarly to models trained with labels. However, in 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Pedro Hermosilla , Christian Stippel , Leon Sick

Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synthetically generated…

Computer Vision and Pattern Recognition · Computer Science 2018-01-18 Nikolaus Mayer , Eddy Ilg , Philip Häusser , Philipp Fischer , Daniel Cremers , Alexey Dosovitskiy , Thomas Brox

LiDAR scene flow is the task of estimating per-point 3D motion between consecutive point clouds. Recent methods achieve centimeter-level accuracy on popular autonomous vehicle (AV) datasets, but are typically only trained and evaluated on a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Siyi Li , Qingwen Zhang , Ishan Khatri , Kyle Vedder , Eric Eaton , Deva Ramanan , Neehar Peri

Manual annotation of large-scale point cloud dataset for varying tasks such as 3D object classification, segmentation and detection is often laborious owing to the irregular structure of point clouds. Self-supervised learning, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Mohamed Afham , Isuru Dissanayake , Dinithi Dissanayake , Amaya Dharmasiri , Kanchana Thilakarathna , Ranga Rodrigo

Scene flow prediction is a crucial underlying task in understanding dynamic scenes as it offers fundamental motion information. However, contemporary scene flow methods encounter three major challenges. Firstly, flow estimation solely based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Zhiyang Lu , Qinghan Chen , Ming Cheng

Event cameras respond to scene dynamics and offer advantages to estimate motion. Following recent image-based deep-learning achievements, optical flow estimation methods for event cameras have rushed to combine those image-based methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego