English
Related papers

Related papers: Eikonal Fields for Refractive Novel-View Synthesis

200 papers

Recent research explosion on Neural Radiance Field (NeRF) shows the encouraging potential to represent complex scenes with neural networks. One major drawback of NeRF is its prohibitive inference time: Rendering a single pixel requires…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Huan Wang , Jian Ren , Zeng Huang , Kyle Olszewski , Menglei Chai , Yun Fu , Sergey Tulyakov

We present a method for generating consistent novel views from a single source image. Our approach focuses on maximizing the reuse of visible pixels from the source image. To achieve this, we use a monocular depth estimator that transfers…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Yash Kant , Aliaksandr Siarohin , Michael Vasilkovsky , Riza Alp Guler , Jian Ren , Sergey Tulyakov , Igor Gilitschenski

In this article we develop an image based rendering technique based on light field reconstruction from a limited set of perspective views acquired by cameras. Our approach utilizes sparse representation of epipolar-plane images in a…

Computer Vision and Pattern Recognition · Computer Science 2015-10-01 Suren Vagharshakyan , Robert Bregovic , Atanas Gotchev

A light field records numerous light rays from a real-world scene. However, capturing a dense light field by existing devices is a time-consuming process. Besides, reconstructing a large amount of light rays equivalent to multiple light…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Mantang Guo , Hao Zhu , Guoqing Zhou , Qing Wang

Neural Radiance Fields (NeRFs) have demonstrated prominent performance in novel view synthesis. However, their input heavily relies on image acquisition under normal light conditions, making it challenging to learn accurate scene…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Min Wang , Xin Huang , Guoqing Zhou , Qifeng Guo , Qing Wang

In this work, we present a novel learning-based approach to synthesize new views of a light field image. In particular, given the four corner views of a light field, the presented method estimates any in-between view. We use three…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Julia Navarro , Neus Sabater

Recent works use the Neural radiance field (NeRF) to perform multi-view 3D reconstruction, providing a significant leap in rendering photorealistic scenes. However, despite its efficacy, NeRF exhibits limited capability of learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Congyue Deng , Jiawei Yang , Leonidas Guibas , Yue Wang

Novel-view synthesis (NVS) can be tackled through different approaches, depending on the general setting: a single source image to a short video sequence, exact or noisy camera pose information, 3D-based information such as point clouds…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Gaétan Landreau , Mohamed Tamaazousti

Recently, significant progress has been made in the study of methods for 3D reconstruction from multiple images using implicit neural representations, exemplified by the neural radiance field (NeRF) method. Such methods, which are based on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Wooseok Kim , Taiki Fukiage , Takeshi Oishi

We introduce a high resolution spatially adaptive light source, or a projector, into a neural reflectance field that allows to both calibrate the projector and photo realistic light editing. The projected texture is fully differentiable…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Yotam Erel , Daisuke Iwai , Amit H. Bermano

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scene novel view…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yuxin Wang , Wayne Wu , Dan Xu

We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene. Recent approaches are computationally expensive, require per-scene optimization, or produce a memory-expensive…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Pavel Solovev , Taras Khakhulin , Denis Korzhenkov

Neural Radiance Fields (NeRF) have emerged as a potent paradigm for representing scenes and synthesizing photo-realistic images. A main limitation of conventional NeRFs is that they often fail to produce high-quality renderings under novel…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Jian Zhang , Yuanqing Zhang , Huan Fu , Xiaowei Zhou , Bowen Cai , Jinchi Huang , Rongfei Jia , Binqiang Zhao , Xing Tang

Synthesizing extrapolated views remains a difficult task, especially in urban driving scenes, where the only reliable sources of data are limited RGB captures and sparse LiDAR points. To address this problem, we present PointmapDiff, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Thang-Anh-Quan Nguyen , Nathan Piasco , Luis Roldão , Moussab Bennehar , Dzmitry Tsishkou , Laurent Caraffa , Jean-Philippe Tarel , Roland Brémond

With the introduction of consumer light field cameras, light field imaging has recently become widespread. However, there is an inherent trade-off between the angular and spatial resolution, and thus, these cameras often sparsely sample in…

Computer Vision and Pattern Recognition · Computer Science 2016-09-13 Nima Khademi Kalantari , Ting-Chun Wang , Ravi Ramamoorthi

A classical problem in computer vision is to infer a 3D scene representation from few images that can be used to render novel views at interactive rates. Previous work focuses on reconstructing pre-defined 3D representations, e.g. textured…

Neural radiance fields enable novel-view synthesis and scene reconstruction with photorealistic quality from a few images, but require known and accurate camera poses. Conventional pose estimation algorithms fail on smooth or self-similar…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Axel Levy , Mark Matthews , Matan Sela , Gordon Wetzstein , Dmitry Lagun

Neural Radiance Field (NeRF) has been a mainstream in novel view synthesis with its remarkable quality of rendered images and simple architecture. Although NeRF has been developed in various directions improving continuously its…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Seunghyeon Seo , Yeonjin Chang , Nojun Kwak

In real-world road scenes, diverse material properties lead to complex light reflection phenomena, making accurate color reproduction crucial for enhancing the realism and safety of simulated driving environments. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Hongsheng Wang , Yang Wang , Yalan Liu , Fayuan Hu , Shengyu Zhang , Fei Wu , Feng Lin

Recent neural rendering and reconstruction techniques, such as NeRFs or Gaussian Splatting, have shown remarkable novel view synthesis capabilities but require hundreds of images of the scene from diverse viewpoints to render high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Felix Tristram , Stefano Gasperini , Nassir Navab , Federico Tombari