English
Related papers

Related papers: GO-NeRF: Generating Objects in Neural Radiance Fie…

200 papers

We present MAV3D (Make-A-Video3D), a method for generating three-dimensional dynamic scenes from text descriptions. Our approach uses a 4D dynamic Neural Radiance Field (NeRF), which is optimized for scene appearance, density, and motion…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Uriel Singer , Shelly Sheynin , Adam Polyak , Oron Ashual , Iurii Makarov , Filippos Kokkinos , Naman Goyal , Andrea Vedaldi , Devi Parikh , Justin Johnson , Yaniv Taigman

The quality of three-dimensional reconstruction is a key factor affecting the effectiveness of its application in areas such as virtual reality (VR) and augmented reality (AR) technologies. Neural Radiance Fields (NeRF) can generate…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Qianqiu Tan , Tao Liu , Yinling Xie , Shuwan Yu , Baohua Zhang

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

We present ONeRF, a method that automatically segments and reconstructs object instances in 3D from multi-view RGB images without any additional manual annotations. The segmented 3D objects are represented using separate Neural Radiance…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Shengnan Liang , Yichen Liu , Shangzhe Wu , Yu-Wing Tai , Chi-Keung Tang

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

This paper aims to tackle the challenge of efficiently producing interactive free-viewpoint videos. Some recent works equip neural radiance fields with image encoders, enabling them to generalize across scenes. When processing dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Haotong Lin , Sida Peng , Zhen Xu , Yunzhi Yan , Qing Shuai , Hujun Bao , Xiaowei Zhou

Neural radiance fields (NeRFs) are promising 3D representations for scenes, objects, and humans. However, most existing methods require multi-view inputs and per-scene training, which limits their real-life applications. Moreover, current…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Xuan Huang , Hanhui Li , Zejun Yang , Zhisheng Wang , Xiaodan Liang

We present a novel optimization algorithm called DroNeRF for the autonomous positioning of monocular camera drones around an object for real-time 3D reconstruction using only a few images. Neural Radiance Fields or NeRF, is a novel view…

Robotics · Computer Science 2023-08-08 Dipam Patel , Phu Pham , Aniket Bera

Contemporary registration devices for 3D visual information, such as LIDARs and various depth cameras, capture data as 3D point clouds. In turn, such clouds are challenging to be processed due to their size and complexity. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Dominik Zimny , Joanna Waczyńska , Tomasz Trzciński , Przemysław Spurek

Neural Radiance Fields (NeRF) is a novel implicit 3D reconstruction method that shows immense potential and has been gaining increasing attention. It enables the reconstruction of 3D scenes solely from a set of photographs. However, its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Jiaming Gu , Minchao Jiang , Hongsheng Li , Xiaoyuan Lu , Guangming Zhu , Syed Afaq Ali Shah , Liang Zhang , Mohammed Bennamoun

Virtual tour among sparse 360$^\circ$ images is widely used while hindering smooth and immersive roaming experiences. The emergence of Neural Radiance Field (NeRF) has showcased significant progress in synthesizing novel views, unlocking…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Huajian Huang , Yingshu Chen , Tianjia Zhang , Sai-Kit Yeung

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

Neural Radiance Fields (NeRFs) have become a widely-applied scene representation technique in recent years, showing advantages for robot navigation and manipulation tasks. To further advance the utility of NeRFs for robotics, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Jiankai Sun , Yan Xu , Mingyu Ding , Hongwei Yi , Chen Wang , Jingdong Wang , Liangjun Zhang , Mac Schwager

Toward unlocking the potential of generative models in immersive 4D experiences, we introduce Virtual Pet, a novel pipeline to model realistic and diverse motions for target animal species within a 3D environment. To circumvent the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Yen-Chi Cheng , Chieh Hubert Lin , Chaoyang Wang , Yash Kant , Sergey Tulyakov , Alexander Schwing , Liangyan Gui , Hsin-Ying Lee

NeRF's high-quality scene synthesis capability was quickly accepted by scholars in the years after it was proposed, and significant progress has been made in 3D scene representation and synthesis. However, the high computational cost limits…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Shun Fang , Ming Cui , Xing Feng , Yanan Zhang

Text-driven 3D scene generation techniques have made rapid progress in recent years. Their success is mainly attributed to using existing generative models to iteratively perform image warping and inpainting to generate 3D scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Frank Zhang , Yibo Zhang , Quan Zheng , Rui Ma , Wei Hua , Hujun Bao , Weiwei Xu , Changqing Zou

Neural Radiance Fields (NeRF) have emerged as a powerful tool for creating highly detailed and photorealistic scenes. Existing methods for NeRF-based 3D style transfer need extensive per-scene optimization for single or multiple styles,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Adil Meric , Umut Kocasari , Matthias Nießner , Barbara Roessle

3D modeling holds significant importance in the realms of AR/VR and gaming, allowing for both artistic creativity and practical applications. However, the process is often time-consuming and demands a high level of skill. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Eddy Chu , Yiyang Chen , Chedy Raissi , Anand Bhojan

Neural radiance fields (NeRF) appeared recently as a powerful tool to generate realistic views of objects and confined areas. Still, they face serious challenges with open scenes, where the camera has unrestricted movement and content can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Ahmad AlMughrabi , Umair Haroon , Ricardo Marques , Petia Radeva

Dynamic neural radiance fields (dynamic NeRFs) have demonstrated impressive results in novel view synthesis on 3D dynamic scenes. However, they often require complete video sequences for training followed by novel view synthesis, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Zhiwen Yan , Chen Li , Gim Hee Lee