中文
相关论文

相关论文: Decomposing 3D Scenes into Objects via Unsupervise…

200 篇论文

Obtaining 3D object representations is important for creating photo-realistic simulations and for collecting AR and VR assets. Neural fields have shown their effectiveness in learning a continuous volumetric representation of a scene from…

计算机视觉与模式识别 · 计算机科学 2022-09-05 Ashkan Mirzaei , Yash Kant , Jonathan Kelly , Igor Gilitschenski

Neural Radiance Fields (NeRFs) have proven to be powerful 3D representations, capable of high quality novel view synthesis of complex scenes. While NeRFs have been applied to graphics, vision, and robotics, problems with slow rendering…

This paper presents a novel approach to inpainting 3D regions of a scene, given masked multi-view images, by distilling a 2D diffusion model into a learned 3D scene representation (e.g. a NeRF). Unlike 3D generative methods that explicitly…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Kira Prabhu , Jane Wu , Lynn Tsai , Peter Hedman , Dan B Goldman , Ben Poole , Michael Broxton

3D reconstruction technology generates three-dimensional representations of real-world objects, scenes, or environments using sensor data such as 2D images, with extensive applications in robotics, autonomous vehicles, and virtual reality…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Hong Zhang , Fei Guo , Zihan Xie , Dizhao Yao

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a…

In this work, we introduce SCALAR-NeRF, a novel framework tailored for scalable large-scale neural scene reconstruction. We structure the neural representation as an encoder-decoder architecture, where the encoder processes 3D point…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Yu Chen , Gim Hee Lee

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

计算机视觉与模式识别 · 计算机科学 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

Humans perceive the 3D world as a set of distinct objects that are characterized by various low-level (geometry, reflectance) and high-level (connectivity, adjacency, symmetry) properties. Recent methods based on convolutional neural…

计算机视觉与模式识别 · 计算机科学 2020-04-03 Despoina Paschalidou , Luc van Gool , Andreas Geiger

Despite the rapid development of Neural Radiance Field (NeRF), the necessity of dense covers largely prohibits its wider applications. While several recent works have attempted to address this issue, they either operate with sparse views…

计算机视觉与模式识别 · 计算机科学 2022-08-15 Dejia Xu , Yifan Jiang , Peihao Wang , Zhiwen Fan , Humphrey Shi , Zhangyang Wang

View synthesis methods using implicit continuous shape representations learned from a set of images, such as the Neural Radiance Field (NeRF) method, have gained increasing attention due to their high quality imagery and scalability to high…

计算机视觉与模式识别 · 计算机科学 2021-05-20 Guo-Wei Yang , Wen-Yang Zhou , Hao-Yang Peng , Dun Liang , Tai-Jiang Mu , Shi-Min Hu

Fully unsupervised 3D representation learning has gained attention owing to its advantages in data collection. A successful approach involves a viewpoint-aware approach that learns an image distribution based on generative models (e.g.,…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Takuhiro Kaneko

In this study, we present a method for synthesizing novel views from a single 360-degree RGB-D image based on the neural radiance field (NeRF) . Prior studies relied on the neighborhood interpolation capability of multi-layer perceptrons to…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Takayuki Hara , Tatsuya Harada

3D-aware image synthesis encompasses a variety of tasks, such as scene generation and novel view synthesis from images. Despite numerous task-specific methods, developing a comprehensive model remains challenging. In this paper, we present…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Hansheng Chen , Jiatao Gu , Anpei Chen , Wei Tian , Zhuowen Tu , Lingjie Liu , Hao Su

The quality of three-dimensional reconstruction is a key factor affecting the effectiveness of its application in areas such as virtual reality (VR) and augmented reality (AR) technologies. Neural Radiance Fields (NeRF) can generate…

计算机视觉与模式识别 · 计算机科学 2023-06-09 Qianqiu Tan , Tao Liu , Yinling Xie , Shuwan Yu , Baohua Zhang

Neural radiance fields (NeRFs) have emerged as a prominent pre-training paradigm for vision-centric autonomous driving, which enhances 3D geometry and appearance understanding in a fully self-supervised manner. To apply NeRF-based…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Hyeonjun Jeong , Juyeb Shin , Dongsuk Kum

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

Neural Radiance Fields (NeRF) have constituted a remarkable breakthrough in image-based 3D reconstruction. However, their implicit volumetric representations differ significantly from the widely-adopted polygonal meshes and lack support…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Jiaxiang Tang , Hang Zhou , Xiaokang Chen , Tianshu Hu , Errui Ding , Jingdong Wang , Gang Zeng

We propose a novel explicit dense 3D reconstruction approach that processes a set of images of a scene with sensor poses and calibrations and estimates a photo-real digital model. One of the key innovations is that the underlying volumetric…

计算机视觉与模式识别 · 计算机科学 2022-03-02 Samir Aroudj , Steven Lovegrove , Eddy Ilg , Tanner Schmidt , Michael Goesele , Richard Newcombe

We propose a simple yet effective pipeline for stylizing a 3D scene, harnessing the power of 2D image diffusion models. Given a NeRF model reconstructed from a set of multi-view images, we perform 3D style transfer by refining the source…

计算机视觉与模式识别 · 计算机科学 2024-09-05 Haruo Fujiwara , Yusuke Mukuta , Tatsuya Harada

We cast multiview reconstruction from unknown pose as a generative modeling problem. From a collection of unannotated 2D images of a scene, our approach simultaneously learns both a network to predict camera pose from 2D image input, as…

计算机视觉与模式识别 · 计算机科学 2024-06-12 Xin Yuan , Rana Hanocka , Michael Maire