English
Related papers

Related papers: Automating 3D Dataset Generation with Neural Radia…

200 papers

Virtual environments (VEs) are pivotal for virtual, augmented, and mixed reality systems. Despite advances in 3D generation and reconstruction, the direct creation of 3D objects within an established 3D scene (represented as NeRF) for novel…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Peng Dai , Feitong Tan , Xin Yu , Yifan Peng , Yinda Zhang , Xiaojuan Qi

Recent advances in deep learning methods have increased the performance of face detection and recognition systems. The accuracy of these models relies on the range of variation provided in the training data. Creating a dataset that…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Shubhajit Basak , Hossein Javidnia , Faisal Khan , Rachel McDonnell , Michael Schukat

Existing 3D-from-2D generators are typically designed for well-curated single-category datasets, where all the objects have (approximately) the same scale, 3D location, and orientation, and the camera always points to the center of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Ivan Skorokhodov , Aliaksandr Siarohin , Yinghao Xu , Jian Ren , Hsin-Ying Lee , Peter Wonka , Sergey Tulyakov

Robotic grasping of house-hold objects has made remarkable progress in recent years. Yet, human grasps are still difficult to synthesize realistically. There are several key reasons: (1) the human hand has many degrees of freedom (more than…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Korrawe Karunratanakul , Jinlong Yang , Yan Zhang , Michael Black , Krikamol Muandet , Siyu Tang

Autonomous driving, in recent years, has been receiving increasing attention for its potential to relieve drivers' burdens and improve the safety of driving. In modern autonomous driving pipelines, the perception system is an indispensable…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Jiageng Mao , Shaoshuai Shi , Xiaogang Wang , Hongsheng Li

3D object detection and pose estimation has been studied extensively in recent decades for its potential applications in robotics. However, there still remains challenges when we aim at detecting multiple objects while retaining low false…

Robotics · Computer Science 2017-03-14 Ruotao He , Juan Rojas , Yisheng Guan

Recently, Neural Radiance Fields (NeRF) achieved impressive results in novel view synthesis. Block-NeRF showed the capability of leveraging NeRF to build large city-scale models. For large-scale modeling, a mass of image data is necessary.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Tong Qin , Changze Li , Haoyang Ye , Shaowei Wan , Minzhen Li , Hongwei Liu , Ming Yang

Simulation is increasingly being used for generating large labelled datasets in many machine learning problems. Recent methods have focused on adjusting simulator parameters with the goal of maximising accuracy on a validation task, usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Harkirat Singh Behl , Atılım Güneş Baydin , Ran Gal , Philip H. S. Torr , Vibhav Vineet

The availability of rich 3D datasets corresponding to the geometrical complexity of the built environments is considered an ongoing challenge for 3D deep learning methodologies. To address this challenge, we introduce GenScan, a generative…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Mohammad Keshavarzi , Oladapo Afolabi , Luisa Caldas , Allen Y. Yang , Avideh Zakhor

Recently, there has been growing interest in developing learning-based methods to detect and utilize salient semi-global or global structures, such as junctions, lines, planes, cuboids, smooth surfaces, and all types of symmetries, for 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Jia Zheng , Junfei Zhang , Jing Li , Rui Tang , Shenghua Gao , Zihan Zhou

The advent of generative radiance fields has significantly promoted the development of 3D-aware image synthesis. The cumulative rendering process in radiance fields makes training these generative models much easier since gradients are…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Xudong Xu , Xingang Pan , Dahua Lin , Bo Dai

As several industries are moving towards modeling massive 3D virtual worlds, the need for content creation tools that can scale in terms of the quantity, quality, and diversity of 3D content is becoming evident. In our work, we aim to train…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Jun Gao , Tianchang Shen , Zian Wang , Wenzheng Chen , Kangxue Yin , Daiqing Li , Or Litany , Zan Gojcic , Sanja Fidler

Diffusion-based text-to-image models ignited immense attention from the vision community, artists, and content creators. Broad adoption of these models is due to significant improvement in the quality of generations and efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Tianfu Wang , Menelaos Kanakis , Konrad Schindler , Luc Van Gool , Anton Obukhov

We investigate the use of Neural Radiance Fields (NeRF) to learn high quality 3D object category models from collections of input images. In contrast to previous work, we are able to do this whilst simultaneously separating foreground…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Christopher Xie , Keunhong Park , Ricardo Martin-Brualla , Matthew Brown

Text-driven 3D scene generation is widely applicable to video gaming, film industry, and metaverse applications that have a large demand for 3D scenes. However, existing text-to-3D generation methods are limited to producing 3D objects with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

Recent years have seen remarkable progress in deep learning powered visual content creation. This includes deep generative 3D-aware image synthesis, which produces high-idelity images in a 3D-consistent manner while simultaneously capturing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Weihao Xia , Jing-Hao Xue

There hardly exists any large-scale datasets with dense optical flow of non-rigid motion from real-world imagery as of today. The reason lies mainly in the required setup to derive ground truth optical flows: a series of images with known…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Hoàng-Ân Lê , Tushar Nimbhorkar , Thomas Mensink , Anil S. Baslamisli , Sezer Karaoglu , Theo Gevers

We introduce a Generalizable Neural Radiance Field approach for predicting 3D workspace occupancy from egocentric robot observations. Unlike prior methods operating in camera-centric coordinates, our model constructs occupancy…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Martin Gromniak , Jan-Gerrit Habekost , Sebastian Kamp , Sven Magg , Stefan Wermter

Recent breakthroughs in text-guided image generation have led to remarkable progress in the field of 3D synthesis from text. By optimizing neural radiance fields (NeRF) directly from text, recent methods are able to produce remarkable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Dana Cohen-Bar , Elad Richardson , Gal Metzer , Raja Giryes , Daniel Cohen-Or

We tackle open-vocabulary 3D scene understanding by introducing a novel data generation pipeline and training framework. Our method addresses three critical requirements for effective training: precise 3D region segmentation, comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Junha Lee , Chunghyun Park , Jaesung Choe , Yu-Chiang Frank Wang , Jan Kautz , Minsu Cho , Chris Choy