English
Related papers

Related papers: Automated Scene Flow Data Generation for Training …

200 papers

The finding that very large networks can be trained efficiently and reliably has led to a paradigm shift in computer vision from engineered solutions to learning formulations. As a result, the research challenge shifts from devising…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Nikolaus Mayer , Eddy Ilg , Philipp Fischer , Caner Hazirbas , Daniel Cremers , Alexey Dosovitskiy , Thomas Brox

The ability to map descriptions of scenes to 3D geometric representations has many applications in areas such as art, education, and robotics. However, prior work on the text to 3D scene generation task has used manually specified object…

Computation and Language · Computer Science 2015-06-08 Angel Chang , Will Monroe , Manolis Savva , Christopher Potts , Christopher D. Manning

Point cloud scene flow estimation is of practical importance for dynamic scene navigation in autonomous driving. Since scene flow labels are hard to obtain, current methods train their models on synthetic data and transfer them to real…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Zhao Jin , Yinjie Lei , Naveed Akhtar , Haifeng Li , Munawar Hayat

In this paper, we explore how synthetically generated 3D face models can be used to construct a high accuracy ground truth for depth. This allows us to train the Convolutional Neural Networks (CNN) to solve facial depth estimation problems.…

Image and Video Processing · Electrical Eng. & Systems 2020-03-27 Faisal Khan , Shubhajit Basak , Hossein Javidnia , Michael Schukat , Peter Corcoran

We present Seen2Scene, the first flow matching-based approach that trains directly on incomplete, real-world 3D scans for scene completion and generation. Unlike prior methods that rely on complete and hence synthetic 3D data, our approach…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Quan Meng , Yujin Chen , Lei Li , Matthias Nießner , Angela Dai

There hardly exists any large-scale datasets with dense optical flow of non-rigid motion from real-world imagery as of today. The reason lies mainly in the required setup to derive ground truth optical flows: a series of images with known…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Hoàng-Ân Lê , Tushar Nimbhorkar , Thomas Mensink , Anil S. Baslamisli , Sezer Karaoglu , Theo Gevers

We propose a data-driven scene flow estimation algorithm exploiting the observation that many 3D scenes can be explained by a collection of agents moving as rigid bodies. At the core of our method lies a deep architecture able to reason at…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Zan Gojcic , Or Litany , Andreas Wieser , Leonidas J. Guibas , Tolga Birdal

3D scene flow characterizes how the points at the current time flow to the next time in the 3D Euclidean space, which possesses the capacity to infer autonomously the non-rigid motion of all objects in the scene. The previous methods for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Chaokang Jiang , Guangming Wang , Yanzi Miao , Hesheng Wang

In this work we present a framework for the recognition of natural scene text. Our framework does not require any human-labelled data, and performs word recognition on the whole image holistically, departing from the character based…

Computer Vision and Pattern Recognition · Computer Science 2014-12-10 Max Jaderberg , Karen Simonyan , Andrea Vedaldi , Andrew Zisserman

Image synthesis driven by computer graphics achieved recently a remarkable realism, yet synthetic image data generated this way reveals a significant domain gap with respect to real-world data. This is especially true in autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Artem Savkin , Rachid Ellouze , Nassir Navab , Federico Tombari

The optical flow of humans is well known to be useful for the analysis of human action. Given this, we devise an optical flow algorithm specifically for human motion and show that it is superior to generic flow methods. Designing a method…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Anurag Ranjan , Javier Romero , Michael J. Black

Scene flow is the three-dimensional (3D) motion field of a scene. It provides information about the spatial arrangement and rate of change of objects in dynamic environments. Current learning-based approaches seek to estimate the scene flow…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Jhony Kaesemodel Pontes , James Hays , Simon Lucey

Developing deep neural networks to generate 3D scenes is a fundamental problem in neural synthesis with immediate applications in architectural CAD, computer graphics, as well as in generating virtual robot training environments. This task…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Haitao Yang , Zaiwei Zhang , Siming Yan , Haibin Huang , Chongyang Ma , Yi Zheng , Chandrajit Bajaj , Qixing Huang

Capturing and labeling real-world 3D data is laborious and time-consuming, which makes it costly to train strong 3D models. To address this issue, recent works present a simple method by generating randomized 3D scenes without simulation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Lanxiao Li , Michael Heizmann

Synthetic data is being used lately for training deep neural networks in computer vision applications such as object detection, object segmentation and 6D object pose estimation. Domain randomization hereby plays an important role in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Parth Rawal , Mrunal Sompura , Wolfgang Hintze

Optical flow is the motion of a pixel between at least two consecutive video frames and can be estimated through an end-to-end trainable convolutional neural network. To this end, large training datasets are required to improve the accuracy…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Roman Seidel , André Apitzsch , Gangolf Hirtz

Synthetic data is emerging as a promising solution to the scalability issue of supervised deep learning, especially when real data are difficult to acquire or hard to annotate. Synthetic data generation, however, can itself be prohibitively…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Aayush Prakash , Shoubhik Debnath , Jean-Francois Lafleche , Eric Cameracci , Gavriel State , Stan Birchfield , Marc T. Law

Scene flow represents the 3D motion of each point in the scene, which explicitly describes the distance and the direction of each point's movement. Scene flow estimation is used in various applications such as autonomous driving fields,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Guangming Wang , Zhiheng Feng , Chaokang Jiang , Hesheng Wang

Scene flow is the task of estimating 3D motion vectors to individual points of a dynamic 3D scene. Motion vectors have shown to be beneficial for downstream tasks such as action classification and collision avoidance. However, data…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Victor Zuanazzi

While recent methods for motion and stereo estimation recover an unprecedented amount of details, such highly detailed structures are neither adequately reflected in the data of existing benchmarks nor their evaluation methodology. Hence,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Lukas Mehl , Jenny Schmalfuss , Azin Jahedi , Yaroslava Nalivayko , Andrés Bruhn