English
Related papers

Related papers: Complex-Valued Holographic Radiance Fields

200 papers

We propose a scene-level inverse rendering framework that uses multi-view images to decompose the scene into geometry, a SVBRDF, and 3D spatially-varying lighting. Because multi-view images provide a variety of information about the scene,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 JunYong Choi , SeokYeong Lee , Haesol Park , Seung-Won Jung , Ig-Jae Kim , Junghyun Cho

Reconstructing complex reflections in real-world scenes from 2D images is essential for achieving photorealistic novel view synthesis. Existing methods that utilize environment maps to model reflections from distant lighting often struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Tao Xie , Xi Chen , Zhen Xu , Yiman Xie , Yudong Jin , Yujun Shen , Sida Peng , Hujun Bao , Xiaowei Zhou

High dynamic range (HDR) imaging is an important task in image processing that aims to generate well-exposed images in scenes with varying illumination. Although existing multi-exposure fusion methods have achieved impressive results,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Jun Xiao , Qian Ye , Tianshan Liu , Cong Zhang , Kin-Man Lam

We propose a novel cross-spectral rendering framework based on 3D Gaussian Splatting (3DGS) that generates realistic and semantically meaningful splats from registered multi-view spectrum and segmentation maps. This extension enhances the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Saptarshi Neil Sinha , Holger Graf , Michael Weinmann

Complex field imaging, which captures both the amplitude and phase information of input optical fields or objects, can offer rich structural insights into samples, such as their absorption and refractive index distributions. However,…

Optics · Physics 2024-05-30 Jingxi Li , Yuhang Li , Tianyi Gan , Che-Yung Shen , Mona Jarrahi , Aydogan Ozcan

Fast, reliable shape reconstruction is an essential ingredient in many computer vision applications. Neural Radiance Fields demonstrated that photorealistic novel view synthesis is within reach, but was gated by performance requirements for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Leonid Keselman , Martial Hebert

We consider the challenging problem of outdoor lighting estimation for the goal of photorealistic virtual object insertion into photographs. Existing works on outdoor lighting estimation typically simplify the scene lighting into an…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Zian Wang , Wenzheng Chen , David Acuna , Jan Kautz , Sanja Fidler

Nowadays it is prevalent to take features extracted from pre-trained deep learning models as image representations which have achieved promising classification performance. Existing methods usually consider either object-based features or…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Chiranjibi Sitaula , Yong Xiang , Anish Basnet , Sunil Aryal , Xuequan Lu

Neural radiance fields provide state-of-the-art view synthesis quality but tend to be slow to render. One reason is that they make use of volume rendering, thus requiring many samples (and model queries) per ray at render time. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Haithem Turki , Vasu Agrawal , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder , Deva Ramanan , Michael Zollhöfer , Christian Richardt

The field of novel-view synthesis has recently witnessed the emergence of 3D Gaussian Splatting, which represents scenes in a point-based manner and renders through rasterization. This methodology, in contrast to Radiance Fields that rely…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Fengyi Zhang , Yadan Luo , Tianjun Zhang , Lin Zhang , Zi Huang

Holographic displays generate Three-Dimensional (3D) images by displaying single-color holograms time-sequentially, each lit by a single-color light source. However, representing each color one by one limits brightness in holographic…

Graphics · Computer Science 2023-10-09 Koray Kavaklı , Liang Shi , Hakan Ürey , Wojciech Matusik , Kaan Akşit

Rendering novel view images is highly desirable for many applications. Despite recent progress, it remains challenging to render high-fidelity and view-consistent novel views of large-scale scenes from in-the-wild images with inevitable…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Peng Dai , Yinda Zhang , Xin Yu , Xiaoyang Lyu , Xiaojuan Qi

The reconstruction and novel view synthesis of dynamic scenes recently gained increased attention. As reconstruction from large-scale multi-view data involves immense memory and computational requirements, recent benchmark datasets provide…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Moritz Kappel , Vladislav Golyanik , Susana Castillo , Christian Theobalt , Marcus Magnor

Neural Radiances Fields (NeRF) and their extensions have shown great success in representing 3D scenes and synthesizing novel-view images. However, most NeRF methods take in low-dynamic-range (LDR) images, which may lose details, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Guanjun Wu , Taoran Yi , Jiemin Fang , Wenyu Liu , Xinggang Wang

An optical field is described by the amplitude and phase, and thus has a complex representation described in the complex plane. However, because the only thing we can measure is the amplitude of the complex field on the real axis, it is…

Optics · Physics 2022-08-30 Jeonghun Oh , Herve Hugonnet , YongKeun Park

Temporal interpolation often plays a crucial role to learn meaningful representations in dynamic scenes. In this paper, we propose a novel method to train spatiotemporal neural radiance fields of dynamic scenes based on temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Sungheon Park , Minjung Son , Seokhwan Jang , Young Chun Ahn , Ji-Yeon Kim , Nahyup Kang

Holographic near-eye displays offer unprecedented capabilities for virtual and augmented reality systems, including perceptually important focus cues. Although artificial intelligence--driven algorithms for computer-generated holography…

Graphics · Computer Science 2022-05-06 Suyeon Choi , Manu Gopakumar , Yifan , Peng , Jonghyun Kim , Matthew O'Toole , Gordon Wetzstein

We present a method to reconstruct dynamic scenes from monocular continuous-wave time-of-flight (C-ToF) cameras using raw sensor samples that achieves similar or better accuracy than neural volumetric approaches and is 100x faster. Quickly…

Representing and rendering dynamic scenes from 2D images is a fundamental yet challenging problem in computer vision and graphics. This survey provides a comprehensive review of the evolution and advancements in dynamic scene representation…

Graphics · Computer Science 2025-03-12 Jiaxuan Zhu , Hao Tang

We present a method for transferring the artistic features of an arbitrary style image to a 3D scene. Previous methods that perform 3D stylization on point clouds or meshes are sensitive to geometric reconstruction errors for complex…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Kai Zhang , Nick Kolkin , Sai Bi , Fujun Luan , Zexiang Xu , Eli Shechtman , Noah Snavely