中文
相关论文

相关论文: PAC-NeRF: Physics Augmented Continuum Neural Radia…

200 篇论文

This paper introduces a novel paradigm for the generalizable neural radiance field (NeRF). Previous generic NeRF methods combine multiview stereo techniques with image-based neural rendering for generalization, yielding impressive results,…

计算机视觉与模式识别 · 计算机科学 2024-01-26 Jiaxu Wang , Ziyi Zhang , Renjing Xu

We present MovingParts, a NeRF-based method for dynamic scene reconstruction and part discovery. We consider motion as an important cue for identifying parts, that all particles on the same part share the common motion pattern. From the…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Kaizhi Yang , Xiaoshuai Zhang , Zhiao Huang , Xuejin Chen , Zexiang Xu , Hao Su

While recent NeRF-based generative models achieve the generation of diverse 3D-aware images, these approaches have limitations when generating images that contain user-specified characteristics. In this paper, we propose a novel model,…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Kyungmin Jo , Gyumin Shim , Sanghun Jung , Soyoung Yang , Jaegul Choo

We investigate the use of Neural Radiance Fields (NeRF) to learn high quality 3D object category models from collections of input images. In contrast to previous work, we are able to do this whilst simultaneously separating foreground…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Christopher Xie , Keunhong Park , Ricardo Martin-Brualla , Matthew Brown

Neural Radiance Fields (NeRFs) have emerged as a groundbreaking paradigm for representing 3D objects and scenes by encoding shape and appearance information into the weights of a neural network. Recent studies have demonstrated that these…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Francesco Ballerini , Pierluigi Zama Ramirez , Luigi Di Stefano , Samuele Salti

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

We present neural radiance fields for rendering and temporal (4D) reconstruction of humans in motion (H-NeRF), as captured by a sparse set of cameras or even from a monocular video. Our approach combines ideas from neural scene…

计算机视觉与模式识别 · 计算机科学 2021-11-03 Hongyi Xu , Thiemo Alldieck , Cristian Sminchisescu

We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex…

计算机视觉与模式识别 · 计算机科学 2021-08-19 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Dor Verbin , Peter Hedman , Ben Mildenhall , Todd Zickler , Jonathan T. Barron , Pratul P. Srinivasan

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

We present an end-to-end system for the high-fidelity capture, model reconstruction, and real-time rendering of walkable spaces in virtual reality using neural radiance fields. To this end, we designed and built a custom multi-camera rig to…

Neural scene representations, such as Neural Radiance Fields (NeRF), are based on training a multilayer perceptron (MLP) using a set of color images with known poses. An increasing number of devices now produce RGB-D(color + depth)…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Arnab Dey , Yassine Ahmine , Andrew I. Comport

Training a policy that can generalize to unknown objects is a long standing challenge within the field of robotics. The performance of a policy often drops significantly in situations where an object in the scene was not seen during…

机器人学 · 计算机科学 2025-09-16 Eric Zhu , Mara Levy , Matthew Gwilliam , Abhinav Shrivastava

While deep learning reshaped the classical motion capture pipeline with feed-forward networks, generative models are required to recover fine alignment via iterative refinement. Unfortunately, the existing models are usually hand-crafted or…

计算机视觉与模式识别 · 计算机科学 2021-11-01 Shih-Yang Su , Frank Yu , Michael Zollhoefer , Helge Rhodin

A critical limitation of current methods based on Neural Radiance Fields (NeRF) is that they are unable to quantify the uncertainty associated with the learned appearance and geometry of the scene. This information is paramount in real…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Jianxiong Shen , Antonio Agudo , Francesc Moreno-Noguer , Adria Ruiz

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

计算机视觉与模式识别 · 计算机科学 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

Contemporary registration devices for 3D visual information, such as LIDARs and various depth cameras, capture data as 3D point clouds. In turn, such clouds are challenging to be processed due to their size and complexity. Existing methods…

计算机视觉与模式识别 · 计算机科学 2024-06-13 Dominik Zimny , Joanna Waczyńska , Tomasz Trzciński , Przemysław Spurek

Neural radiance fields (NeRF) has achieved outstanding performance in modeling 3D objects and controlled scenes, usually under a single scale. In this work, we focus on multi-scale cases where large changes in imagery are observed at…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Yuanbo Xiangli , Linning Xu , Xingang Pan , Nanxuan Zhao , Anyi Rao , Christian Theobalt , Bo Dai , Dahua Lin

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

Photorealistic rendering and reposing of humans is important for enabling augmented reality experiences. We propose a novel framework to reconstruct the human and the scene that can be rendered with novel human poses and views from just a…

计算机视觉与模式识别 · 计算机科学 2022-09-23 Wei Jiang , Kwang Moo Yi , Golnoosh Samei , Oncel Tuzel , Anurag Ranjan