中文
相关论文

相关论文: PeRFception: Perception using Radiance Fields

200 篇论文

Since the advent of Neural Radiance Fields, novel view synthesis has received tremendous attention. The existing approach for the generalization of radiance field reconstruction primarily constructs an encoding volume from nearby source…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Jingliang Li , Qiang Zhou , Chaohui Yu , Zhengda Lu , Jun Xiao , Zhibin Wang , Fan Wang

The various aspects like modeling and interpreting 3D environments and surroundings have enticed humans to progress their research in 3D Computer Vision, Computer Graphics, and Machine Learning. An attempt made by Mildenhall et al in their…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Ansh Mittal

Neural Radiance Fields (NeRFs) learn to represent a 3D scene from just a set of registered images. Increasing sizes of a scene demands more complex functions, typically represented by neural networks, to capture all details. Training and…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Tim Elsner , Victor Czech , Julia Berger , Zain Selman , Isaak Lim , Leif Kobbelt

The proposed method, Neural Radiance Projection (NeRP), addresses the three most fundamental shortages of training such a convolutional neural network on X-ray image segmentation: dealing with missing/limited human-annotated datasets;…

图像与视频处理 · 电气工程与系统科学 2022-05-03 Pham Ngoc Huy , Tran Minh Quan

Hinged on the representation power of neural networks, neural radiance fields (NeRF) have recently emerged as one of the promising and widely applicable methods for 3D object and scene representation. However, NeRF faces challenges in…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Jaeyoung Chung , Kanggeon Lee , Sungyong Baik , Kyoung Mu Lee

The rendering procedure used by neural radiance fields (NeRF) samples a scene with a single ray per pixel and may therefore produce renderings that are excessively blurred or aliased when training or testing images observe scene content at…

计算机视觉与模式识别 · 计算机科学 2021-08-17 Jonathan T. Barron , Ben Mildenhall , Matthew Tancik , Peter Hedman , Ricardo Martin-Brualla , Pratul P. Srinivasan

Neural Radiance Fields (NeRF) have demonstrated exceptional capabilities in reconstructing complex scenes with high fidelity. However, NeRF's view dependency can only handle low-frequency reflections. It falls short when handling complex…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Chen Gao , Yipeng Wang , Changil Kim , Jia-Bin Huang , Johannes Kopf

In this paper, we propose HeadNeRF, a novel NeRF-based parametric head model that integrates the neural radiance field to the parametric representation of the human head. It can render high fidelity head images in real-time on modern GPUs,…

计算机视觉与模式识别 · 计算机科学 2022-05-03 Yang Hong , Bo Peng , Haiyao Xiao , Ligang Liu , Juyong Zhang

We aim to improve the Inverted Neural Radiance Fields (iNeRF) algorithm which defines the image pose estimation problem as a NeRF based iterative linear optimization. NeRFs are novel neural space representation models that can synthesize…

计算机视觉与模式识别 · 计算机科学 2023-10-06 Ágoston István Csehi , Csaba Máté Józsa

3D neural implicit representations play a significant component in many robotic applications. However, reconstructing neural radiance fields (NeRF) from realistic event data remains a challenge due to the sparsities and the lack of…

机器人学 · 计算机科学 2024-01-31 Jiaxu Wang , Junhao He , Ziyi Zhang , Renjing Xu

Neural radiance field (NeRF), in particular its extension by instant neural graphics primitives, is a novel rendering method for view synthesis that uses real-world images to build photo-realistic immersive virtual scenes. Despite its…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Ke Li , Tim Rolff , Susanne Schmidt , Reinhard Bacher , Simone Frintrop , Wim Leemans , Frank Steinicke

We present a novel method for reconstructing 3D objects from a single RGB image. Our method leverages the latest image generation models to infer the hidden 3D structure while remaining faithful to the input image. While existing methods…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Senthil Purushwalkam , Nikhil Naik

Neural Radiance Fields (NeRFs) typically struggle to reconstruct and render highly specular objects, whose appearance varies quickly with changes in viewpoint. Recent works have improved NeRF's ability to render detailed specular appearance…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Dor Verbin , Pratul P. Srinivasan , Peter Hedman , Ben Mildenhall , Benjamin Attal , Richard Szeliski , Jonathan T. Barron

Novel view synthesis via Neural Radiance Fields (NeRFs) or 3D Gaussian Splatting (3DGS) typically necessitates dense observations with hundreds of input images to circumvent artifacts. We introduce Deceptive-NeRF/3DGS to enhance sparse-view…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Xinhang Liu , Jiaben Chen , Shiu-hong Kao , Yu-Wing Tai , Chi-Keung Tang

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important…

Articulated objects and their representations pose a difficult problem for robots. These objects require not only representations of geometry and texture, but also of the various connections and joint parameters that make up each…

机器人学 · 计算机科学 2024-09-17 Stanley Lewis , Tom Gao , Odest Chadwicke Jenkins

With Neural Radiance Fields (NeRFs) arising as a powerful 3D representation, research has investigated its various downstream tasks, including inpainting NeRFs with 2D images. Despite successful efforts addressing the view consistency and…

图像与视频处理 · 电气工程与系统科学 2025-04-04 Jingyu Shi , Achleshwar Luthra , Jiazhi Li , Xiang Gao , Xiyun Song , Zongfang Lin , David Gu , Heather Yu

Neural scene representations, such as Neural Radiance Fields (NeRF), are based on training a multilayer perceptron (MLP) using a set of color images with known poses. An increasing number of devices now produce RGB-D(color + depth)…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Arnab Dey , Yassine Ahmine , Andrew I. Comport

In recent years, novel view synthesis has gained popularity in generating high-fidelity images. While demonstrating superior performance in the task of synthesizing novel views, the majority of these methods are still based on the…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Xiaoyan Yang , Dingbo Lu , Yang Li , Chenhui Li , Changbo Wang

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler