English
Related papers

Related papers: GANESH: Generalizable NeRF for Lensless Imaging

200 papers

Combining the signed distance function (SDF) and differentiable volume rendering has emerged as a powerful paradigm for surface reconstruction from multi-view images without 3D supervision. However, current methods are impeded by requiring…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Rui Peng , Xiaodong Gu , Luyang Tang , Shihe Shen , Fanqi Yu , Ronggang Wang

We present TimeNeRF, a generalizable neural rendering approach for rendering novel views at arbitrary viewpoints and at arbitrary times, even with few input views. For real-world applications, it is expensive to collect multiple views and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Hsiang-Hui Hung , Huu-Phu Do , Yung-Hui Li , Ching-Chun Huang

3D scene segmentation based on neural implicit representation has emerged recently with the advantage of training only on 2D supervision. However, existing approaches still requires expensive per-scene optimization that prohibits…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Hanlin Chen , Chen Li , Mengqi Guo , Zhiwen Yan , Gim Hee Lee

We introduce a novel framework for solving inverse problems using NeRF-style generative models. We are interested in the problem of 3-D scene reconstruction given a single 2-D image and known camera parameters. We show that naively…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Giannis Daras , Wen-Sheng Chu , Abhishek Kumar , Dmitry Lagun , Alexandros G. Dimakis

Advancements in high-throughput biomedical applications require real-time, large field-of-view (FOV) imaging. While current 2D lens-free imaging (LFI) systems improve FOV, they are often hindered by time-consuming multi-position…

Despite advancements in Neural Implicit models for 3D surface reconstruction, handling dynamic environments with interactions between arbitrary rigid, non-rigid, or deformable entities remains challenging. The generic reconstruction methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Sandika Biswas , Qianyi Wu , Biplab Banerjee , Hamid Rezatofighi

In this work, we focus on synthesizing high-fidelity novel view images for arbitrary human performers, given a set of sparse multi-view images. It is a challenging task due to the large variation among articulated body poses and heavy…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jianchuan Chen , Wentao Yi , Liqian Ma , Xu Jia , Huchuan Lu

Recent development of lensless imagers has enabled three-dimensional (3D) imaging through a thin piece of optics in close proximity to a camera sensor. A general challenge of wide-field lensless imaging is the high computational complexity…

Optics · Physics 2021-08-17 Feng Tian , Junjie Hu , Weijian Yang

Neural Radiance Field (NeRF) is a promising approach for synthesizing novel views, given a set of images and the corresponding camera poses of a scene. However, images photographed from a low-light scene can hardly be used to train a NeRF…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Haoyuan Wang , Xiaogang Xu , Ke Xu , Rynson WH. Lau

We study the problem of synthesizing immersive 3D indoor scenes from one or more images. Our aim is to generate high-resolution images and videos from novel viewpoints, including viewpoints that extrapolate far beyond the input images while…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Jing Yu Koh , Harsh Agrawal , Dhruv Batra , Richard Tucker , Austin Waters , Honglak Lee , Yinfei Yang , Jason Baldridge , Peter Anderson

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

Neural Radiance Fields (NeRF) methods excel at 3D reconstruction from multiple 2D images, even those taken with unknown camera poses. However, they still miss the fine-detailed structures that matter in industrial inspection, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jong-Ik Park , Carlee Joe-Wong , Gary K. Fedder

The method of neural radiance fields (NeRF) has been developed in recent years, and this technology has promising applications for synthesizing novel views of complex scenes. However, NeRF requires dense input views, typically numbering in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Young Chun Ahn , Seokhwan Jang , Sungheon Park , Ji-Yeon Kim , Nahyup Kang

Neural Radiance Fields (NeRF) have emerged as a powerful tool for creating highly detailed and photorealistic scenes. Existing methods for NeRF-based 3D style transfer need extensive per-scene optimization for single or multiple styles,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Adil Meric , Umut Kocasari , Matthias Nießner , Barbara Roessle

NeRF provides unparalleled fidelity of novel view synthesis: rendering a 3D scene from an arbitrary viewpoint. NeRF requires training on a large number of views that fully cover a scene, which limits its applicability. While these issues…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Pol Moreno , Adam R. Kosiorek , Heiko Strathmann , Daniel Zoran , Rosalia G. Schneider , Björn Winckler , Larisa Markeeva , Théophane Weber , Danilo J. Rezende

Single-view 3D object reconstruction is a fundamental and challenging computer vision task that aims at recovering 3D shapes from single-view RGB images. Most existing deep learning based reconstruction methods are trained and evaluated on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xianghui Yang , Guosheng Lin , Luping Zhou

Lensless cameras relax the design constraints of traditional cameras by shifting image formation from analog optics to digital post-processing. While new camera designs and applications can be enabled, lensless imaging is very sensitive to…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Eric Bezzam , Stefan Peters , Martin Vetterli

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Advances in unsupervised learning of object-representations have culminated in the development of a broad range of methods for unsupervised object segmentation and interpretable object-centric scene generation. These methods, however, are…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Martin Engelcke , Oiwi Parker Jones , Ingmar Posner

We present iNeRF, a framework that performs mesh-free pose estimation by "inverting" a Neural RadianceField (NeRF). NeRFs have been shown to be remarkably effective for the task of view synthesis - synthesizing photorealistic novel views of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Lin Yen-Chen , Pete Florence , Jonathan T. Barron , Alberto Rodriguez , Phillip Isola , Tsung-Yi Lin