English
Related papers

Related papers: SpecNeRF: Gaussian Directional Encoding for Specul…

200 papers

The emergence of neural and Gaussian-based radiance field methods has led to considerable advancements in novel view synthesis and 3D object reconstruction. Nonetheless, specular reflection and refraction continue to pose significant…

Graphics · Computer Science 2025-05-02 Letian Huang , Dongwei Ye , Jialin Dan , Chengzhi Tao , Huiwen Liu , Kun Zhou , Bo Ren , Yuanqi Li , Yanwen Guo , Jie Guo

In this work, we address specular appearance in inverse rendering using 2D Gaussian splatting with deferred shading and argue for a refinement stage to improve specular detail, thereby bridging the gap with reconstruction-only methods. Our…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Georgios Kouros , Minye Wu , Tinne Tuytelaars

Gaussian Splatting has rapidly emerged as a transformative technique for real-time 3D scene representation, offering a highly efficient and expressive alternative to Neural Radiance Fields (NeRF). Its ability to render complex scenes with…

Graphics · Computer Science 2025-08-20 Mahmoud Chick Zaouali , Todd Charter , Yehor Karpichev , Brandon Haworth , Homayoun Najjaran

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Dor Verbin , Peter Hedman , Ben Mildenhall , Todd Zickler , Jonathan T. Barron , Pratul P. Srinivasan

We propose a neural inverse rendering approach that jointly reconstructs geometry, spatially varying reflectance, and lighting conditions from multi-view images captured under varying directional lighting. Unlike prior multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Xu Cao , Takafumi Taketomi

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

Inverse rendering methods aim to estimate geometry, materials and illumination from multi-view RGB images. In order to achieve better decomposition, recent approaches attempt to model indirect illuminations reflected from different…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Haoqian Wu , Zhipeng Hu , Lincheng Li , Yongqiang Zhang , Changjie Fan , Xin Yu

It is desirable to create 3D object models and 3D maps from 2D input images for applications such as navigation, virtual tourism, and urban planning. The traditional methods of creating 3D maps, (such as photogrammetry), require a large…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Sai Tarun Sathyan , Thomas B. Kinsman

Recent works use the Neural radiance field (NeRF) to perform multi-view 3D reconstruction, providing a significant leap in rendering photorealistic scenes. However, despite its efficacy, NeRF exhibits limited capability of learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Congyue Deng , Jiawei Yang , Leonidas Guibas , Yue Wang

Accurately rendering scenes with reflective surfaces remains a significant challenge in novel view synthesis, as existing methods like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) often misinterpret reflections as physical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Jiayi Song , Zihan Ye , Qingyuan Zhou , Weidong Yang , Ben Fei , Jingyi Xu , Ying He , Wanli Ouyang

Ray tracing is widely employed to model the propagation of radio-frequency (RF) signal in complex environment. The modelling performance greatly depends on how accurately the target scene can be depicted, including the scene geometry and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Haifeng Jia , Xinyi Chen , Yichen Wei , Yifei Sun , Yibo Pi

Neural radiance fields (NeRFs) have recently emerged as a promising approach for 3D reconstruction and novel view synthesis. However, NeRF-based methods encode shape, reflectance, and illumination implicitly and this makes it challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Ruofan Liang , Jiahao Zhang , Haoda Li , Chen Yang , Yushi Guan , Nandita Vijaykumar

Dense reconstruction and differentiable rendering are fundamental tightly connected operations in 3D vision and computer graphics. Recent neural implicit representations demonstrate compelling advantages in reconstruction fidelity and…

Robotics · Computer Science 2026-05-25 Zhirui Dai , Hojoon Shin , Yulun Tian , Ki Myung Brian Lee , Nikolay Atanasov

Neural Radiance Fields (NeRFs) provide a high fidelity, continuous scene representation that can realistically represent complex behaviour of light. Despite works like Ref-NeRF improving geometry through physics-inspired models, the ability…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Jack Naylor , Viorela Ila , Donald G. Dansereau

The advent of neural 3D Gaussians has recently brought about a revolution in the field of neural rendering, facilitating the generation of high-quality renderings at real-time speeds. However, the explicit and discrete representation…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yingwenqi Jiang , Jiadong Tu , Yuan Liu , Xifeng Gao , Xiaoxiao Long , Wenping Wang , Yuexin Ma

Recently, significant progress has been made in the study of methods for 3D reconstruction from multiple images using implicit neural representations, exemplified by the neural radiance field (NeRF) method. Such methods, which are based on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Wooseok Kim , Taiki Fukiage , Takeshi Oishi

We present Neural Reflectance Fields, a novel deep scene representation that encodes volume density, normal and reflectance properties at any 3D point in a scene using a fully-connected neural network. We combine this representation with a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Sai Bi , Zexiang Xu , Pratul Srinivasan , Ben Mildenhall , Kalyan Sunkavalli , Miloš Hašan , Yannick Hold-Geoffroy , David Kriegman , Ravi Ramamoorthi

Implicit representations like Neural Radiance Fields (NeRF) showed impressive results for photorealistic rendering of complex scenes with fine details. However, ideal or near-perfectly specular reflecting objects such as mirrors, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Leif Van Holland , Ruben Bliersbach , Jan U. Müller , Patrick Stotko , Reinhard Klein

Recently, Neural Radiance Fields (NeRF) has exhibited significant success in novel view synthesis, surface reconstruction, etc. However, since no physical reflection is considered in its rendering pipeline, NeRF mistakes the reflection in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Junyi Zeng , Chong Bao , Rui Chen , Zilong Dong , Guofeng Zhang , Hujun Bao , Zhaopeng Cui

We present a new method for estimating the Neural Reflectance Field (NReF) of an object from a set of posed multi-view images under unknown lighting. NReF represents 3D geometry and appearance of objects in a disentangled manner, and are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Xiu Li , Xiao Li , Yan Lu