English
Related papers

Related papers: Neural Projection Mapping Using Reflectance Fields

200 papers

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Ashkan Mirzaei , Tristan Aumentado-Armstrong , Konstantinos G. Derpanis , Jonathan Kelly , Marcus A. Brubaker , Igor Gilitschenski , Alex Levinshtein

Neural Radiance Field (NeRF) is a representation for 3D reconstruction from multi-view images. Despite some recent work showing preliminary success in editing a reconstructed NeRF with diffusion prior, they remain struggling to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Chieh Hubert Lin , Changil Kim , Jia-Bin Huang , Qinbo Li , Chih-Yao Ma , Johannes Kopf , Ming-Hsuan Yang , Hung-Yu Tseng

We present Neural Microfacet Fields, a method for recovering materials, geometry, and environment illumination from images of a scene. Our method uses a microfacet reflectance model within a volumetric setting by treating each sample along…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Alexander Mai , Dor Verbin , Falko Kuester , Sara Fridovich-Keil

In this paper, we propose SpectralNeRF, an end-to-end Neural Radiance Field (NeRF)-based architecture for high-quality physically based rendering from a novel spectral perspective. We modify the classical spectral rendering into two main…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ru Li , Jia Liu , Guanghui Liu , Shengping Zhang , Bing Zeng , Shuaicheng Liu

Neural Radiance Field (NeRF) research has attracted significant attention recently, with 3D modelling, virtual/augmented reality, and visual effects driving its application. While current NeRF implementations can produce high quality visual…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Adrian Azzarelli , Nantheera Anantrasirichai , David R Bull

We introduce a fiber-optic architecture for neural recording without contrast agents, and study its properties theoretically. Our sensor design is inspired by electrooptic modulators, which modulate the refractive index of a waveguide by…

Neurons and Cognition · Quantitative Biology 2020-02-04 Samuel G Rodriques , Adam H Marblestone , Max Mankin , Lowell Wood , Edward S Boyden

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

We propose a new method for reconstructing controllable implicit 3D human models from sparse multi-view RGB videos. Our method defines the neural scene representation on the mesh surface points and signed distances from the surface of a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tianhan Xu , Yasuhiro Fujita , Eiichi Matsumoto

We study the problem of novel view synthesis from sparse source observations of a scene comprised of 3D objects. We propose a simple yet effective approach that is neither continuous nor implicit, challenging recent trends on view…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Pengsheng Guo , Miguel Angel Bautista , Alex Colburn , Liang Yang , Daniel Ulbricht , Joshua M. Susskind , Qi Shan

In this paper, we first propose a novel method for transferring material transformations across different scenes. Building on disentangled Neural Radiance Field (NeRF) representations, our approach learns to map Bidirectional Reflectance…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Ivan Lopes , Jean-François Lalonde , Raoul de Charette

Implicit neural rendering techniques have shown promising results for novel view synthesis. However, existing methods usually encode the entire scene as a whole, which is generally not aware of the object identity and limits the ability to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Bangbang Yang , Yinda Zhang , Yinghao Xu , Yijin Li , Han Zhou , Hujun Bao , Guofeng Zhang , Zhaopeng Cui

Three-dimensional ultrasound imaging is a critical technology widely used in medical diagnostics. However, traditional 3D ultrasound imaging methods have limitations such as fixed resolution, low storage efficiency, and insufficient…

Artificial Intelligence · Computer Science 2024-09-16 Ziwen Guo , Zi Fang , Zhuang Fu

Neural Radiance Fields (NeRF) often struggle with reconstructing and rendering highly reflective scenes. Recent advancements have developed various reflection-aware appearance models to enhance NeRF's capability to render specular…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Ji Shi , Xianghua Ying , Ruohao Guo , Bowei Xing , Wenzhen Yue

There has recently been great interest in neural rendering methods. Some approaches use 3D geometry reconstructed with Multi-View Stereo (MVS) but cannot recover from the errors of this process, while others directly learn a volumetric…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Georgios Kopanas , Julien Philip , Thomas Leimkühler , George Drettakis

Neutron reflectometry (NR) is a powerful technique to probe surfaces and interfaces. NR is inherently an indirect measurement technique, access to the physical quantities of interest (layer thickness, scattering length density, roughness),…

We present a new deep point cloud rendering pipeline through multi-plane projections. The input to the network is the raw point cloud of a scene and the output are image or image sequences from a novel view or along a novel camera…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Peng Dai , Yinda Zhang , Zhuwen Li , Shuaicheng Liu , Bing Zeng

Neural Radiance Fields (NeRFs) have remodeled 3D scene representation since release. NeRFs can effectively reconstruct complex 3D scenes from 2D images, advancing different fields and applications such as scene understanding, 3D content…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Wenhui Xiao , Remi Chierchia , Rodrigo Santa Cruz , Xuesong Li , David Ahmedt-Aristizabal , Olivier Salvado , Clinton Fookes , Leo Lebrat

We present a novel 3D pose refinement approach based on differentiable rendering for objects of arbitrary categories in the wild. In contrast to previous methods, we make two main contributions: First, instead of comparing real-world images…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Alexander Grabner , Yaming Wang , Peizhao Zhang , Peihong Guo , Tong Xiao , Peter Vajda , Peter M. Roth , Vincent Lepetit

A lighting-based multispectral imaging system using an RGB camera and a projector is one of the most practical and low-cost systems to acquire multispectral observations for estimating the scene's spectral reflectance information. However,…

Image and Video Processing · Electrical Eng. & Systems 2020-12-21 Hironori Hidaka , Yusuke Monno , Masatoshi Okutomi

Perceptual illusions based on the spatial correspondence between objects and displayed images have been pursued by artists and scientists since the 15th century, mastering optics to create crucial techniques as the linear perspective and…

Multimedia · Computer Science 2020-06-01 Alvaro Pastor