English
Related papers

Related papers: REFRAME: Reflective Surface Real-Time Rendering fo…

200 papers

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

Capturing the 3D geometry of transparent objects is a challenging task, ill-suited for general-purpose scanning and reconstruction techniques, since these cannot handle specular light transport phenomena. Existing state-of-the-art methods,…

Graphics · Computer Science 2020-09-22 Jiahui Lyu , Bojian Wu , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Reconstructing real-world 3D objects has numerous applications in computer vision, such as virtual reality, video games, and animations. Ideally, 3D reconstruction methods should generate high-fidelity results with 3D consistency in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jingnan Gao , Zhuo Chen , Yichao Yan , Bowen Pan , Zhe Wang , Jiangjing Lyu , Xiaokang Yang

Neural Radiance Fields (NeRFs) have revolutionized the field of novel view synthesis, demonstrating remarkable performance. However, the modeling and rendering of reflective objects remain challenging problems. Recent methods have shown…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Georgios Kouros , Minye Wu , Shubham Shrivastava , Sushruth Nagesh , Punarjay Chakravarty , Tinne Tuytelaars

Existing neural reconstruction schemes such as Neural Radiance Field (NeRF) are largely focused on modeling opaque objects. We present a novel neural refractive field(NeReF) to recover wavefront of transparent fluids by simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Ziyu Wang , Wei Yang , Junming Cao , Lan Xu , Junqing Yu , Jingyi Yu

Reconstructing photo-realistic large-scale scenes from images, for example at city scale, is a long-standing problem in computer graphics. Neural rendering is an emerging technique that enables photo-realistic image synthesis from…

Graphics · Computer Science 2025-07-22 Yaru Liu , Derek Nowrouzezahri , Morgan Mcguire

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Mark Boss , Raphael Braun , Varun Jampani , Jonathan T. Barron , Ce Liu , Hendrik P. A. Lensch

Recently, differentiable volume rendering in neural radiance fields (NeRF) has gained a lot of popularity, and its variants have attained many impressive results. However, existing methods usually assume the scene is a homogeneous volume so…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jen-I Pan , Jheng-Wei Su , Kai-Wen Hsiao , Ting-Yu Yen , Hung-Kuo Chu

Modern 3D reconstruction and novel view synthesis approaches have demonstrated strong performance on scenes with opaque Lambertian objects. However, most assume straight light paths and therefore cannot properly handle refractive and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Yue Yin , Enze Tao , Weijian Deng , Dylan Campbell

We propose a new method for realistic real-time novel-view synthesis (NVS) of large scenes. Existing neural rendering methods generate realistic results, but primarily work for small scale scenes (<50 square meters) and have difficulty at…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jeffrey Yunfan Liu , Yun Chen , Ze Yang , Jingkang Wang , Sivabalan Manivasagam , Raquel Urtasun

Achieving high-fidelity 3D surface reconstruction while preserving fine details remains challenging, especially in the presence of materials with complex reflectance properties and without a dense-view setup. In this paper, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Robin Bruneau , Baptiste Brument , Yvain Quéau , Jean Mélou , François Bernard Lauze , Jean-Denis Durou , Lilian Calvet

Structural coloration is commonly modeled using wave optics for reliable and photorealistic rendering of natural, quasi-periodic and complex nanostructures. Such models often rely on dense, preliminary or preprocessed data to accurately…

Graphics · Computer Science 2025-07-03 Narayan Kandel , Daljit Singh J. S. Dhillon

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

Recent history has seen a tremendous growth of work exploring implicit representations of geometry and radiance, popularized through Neural Radiance Fields (NeRF). Such works are fundamentally based on a (implicit) volumetric representation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Jason Y. Zhang , Gengshan Yang , Shubham Tulsiani , Deva Ramanan

Synthesizing NeRFs under arbitrary lighting has become a seminal problem in the last few years. Recent efforts tackle the problem via the extraction of physically-based parameters that can then be rendered under arbitrary lighting, but they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Diego Gomez , Julien Philip , Adrien Kaiser , Élie Michel

View synthesis methods using implicit continuous shape representations learned from a set of images, such as the Neural Radiance Field (NeRF) method, have gained increasing attention due to their high quality imagery and scalability to high…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Guo-Wei Yang , Wen-Yang Zhou , Hao-Yang Peng , Dun Liang , Tai-Jiang Mu , Shi-Min Hu

Reconstructing an object from photos and placing it virtually in a new environment goes beyond the standard novel view synthesis task as the appearance of the object has to not only adapt to the novel viewpoint but also to the new lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Benjamin Ummenhofer , Sanskar Agrawal , Rene Sepulveda , Yixing Lao , Kai Zhang , Tianhang Cheng , Stephan Richter , Shenlong Wang , German Ros

Widespread RGB-Depth (RGB-D) sensors and advanced 3D reconstruction technologies facilitate the capture of indoor spaces, improving the fields of augmented reality (AR), virtual reality (VR), and extended reality (XR). Nevertheless, current…

Robotics · Computer Science 2026-04-22 Seok Joon Kim , Dinh Duc Cao , Federica Spinola , Se Jin Lee , Kyu Sung Cho

This paper addresses the limitations of neural rendering-based multi-view surface reconstruction methods, which require an additional mesh extraction step that is inconvenient and would produce poor-quality surfaces with mesh aliasing,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qitong Zhang , Jieqing Feng

Neural Radiance Fields (NeRF) often struggle with reconstructing and rendering highly reflective scenes. Recent advancements have developed various reflection-aware appearance models to enhance NeRF's capability to render specular…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Ji Shi , Xianghua Ying , Ruohao Guo , Bowei Xing , Wenzhen Yue