English
Related papers

Related papers: LoFi: Neural Local Fields for Scalable Image Recon…

200 papers

Hyperspectral image (HSI) super-resolution without additional auxiliary image remains a constant challenge due to its high-dimensional spectral patterns, where learning an effective spatial and spectral representation is a fundamental…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Kaiwei Zhang

We propose LIRF (Local Implicit Ray Function), a generalizable neural rendering approach for novel view rendering. Current generalizable neural radiance fields (NeRF) methods sample a scene with a single ray per pixel and may therefore…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Xin Huang , Qi Zhang , Ying Feng , Xiaoyu Li , Xuan Wang , Qing Wang

Many classic methods have shown non-local self-similarity in natural images to be an effective prior for image restoration. However, it remains unclear and challenging to make use of this intrinsic property via deep networks. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Ding Liu , Bihan Wen , Yuchen Fan , Chen Change Loy , Thomas S. Huang

Standard single-image super-resolution (SR) upsamples and restores entire images. Yet several real-world applications require higher resolutions only in specific regions, such as license plates or faces, making the super-resolution of the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Bo Ji , Angela Yao

Neural implicit surface representations are currently receiving a lot of interest as a means to achieve high-fidelity surface reconstruction at a low memory cost, compared to traditional explicit representations.However, state-of-the-art…

Robotics · Computer Science 2024-09-20 Shuo Sun , Malcolm Mielle , Achim J. Lilienthal , Martin Magnusson

Implicit surfaces via neural radiance fields (NeRF) have shown surprising accuracy in surface reconstruction. Despite their success in reconstructing richly textured surfaces, existing methods struggle with planar regions with weak…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Albert Gassol Puigjaner , Edoardo Mello Rella , Erik Sandström , Ajad Chhatkuli , Luc Van Gool

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Neural implicit representation has attracted attention in 3D reconstruction through various success cases. For further applications such as scene understanding or editing, several works have shown progress towards object compositional…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Taekbeom Lee , Youngseok Jang , H. Jin Kim

Neural implicit surface reconstruction using volume rendering techniques has recently achieved significant advancements in creating high-fidelity surfaces from multiple 2D images. However, current methods primarily target scenes with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Lintao Xiang , Hongpei Zheng , Bailin Deng , Hujun Yin

The iterative refinement method (IRM) has been very successfully applied in many different fields for examples the modern quantum chemical calculation and CT image reconstruction. It is proved that the refinement method can create an exact…

Medical Physics · Physics 2015-12-23 Kang Yang , Kevin Yang , Xintie Yang , Shuang-Ren Zhao

View synthesis methods using implicit continuous shape representations learned from a set of images, such as the Neural Radiance Field (NeRF) method, have gained increasing attention due to their high quality imagery and scalability to high…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Guo-Wei Yang , Wen-Yang Zhou , Hao-Yang Peng , Dun Liang , Tai-Jiang Mu , Shi-Min Hu

Implicit neural representation (INR) has recently emerged as a promising paradigm for signal representations. Typically, INR is parameterized by a multiplayer perceptron (MLP) which takes the coordinates as the inputs and generates…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Zhicheng Cai

Computational imaging systems jointly design computation and hardware to retrieve information which is not traditionally accessible with standard imaging systems. Recently, critical aspects such as experimental design and image priors are…

Image and Video Processing · Electrical Eng. & Systems 2020-03-13 Michael Kellman , Jon Tamir , Emrah Boston , Michael Lustig , Laura Waller

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler

We present a novel convolutional neural network architecture for photometric stereo (Woodham, 1980), a problem of recovering 3D object surface normals from multiple images observed under varying illuminations. Despite its long history in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Tatsunori Taniai , Takanori Maehara

A robot operating in a household environment will see a wide range of unique and unfamiliar objects. While a system could train on many of these, it is infeasible to predict all the objects a robot will see. In this paper, we present a…

Robotics · Computer Science 2023-03-08 Ethan Chun , Yilun Du , Anthony Simeonov , Tomas Lozano-Perez , Leslie Kaelbling

Inverse problems exist in many domains such as phase imaging, image processing, and computer vision. These problems are often solved with application-specific algorithms, even though their nature remains the same: mapping input image(s) to…

Computational Physics · Physics 2021-10-22 Feng Wang , Alberto Eljarrat , Johannes Müller , Trond Henninen , Erni Rolf , Christoph Koch

Robot localization is an inverse problem of finding a robot's pose using a map and sensor measurements. In recent years, Invertible Neural Networks (INNs) have successfully solved ambiguous inverse problems in various fields. This paper…

Robotics · Computer Science 2022-09-27 Zirui Zang , Hongrui Zheng , Johannes Betz , Rahul Mangharam

This paper tackles the simultaneous optimization of pose and Neural Radiance Fields (NeRF). Departing from the conventional practice of using explicit global representations for camera pose, we propose a novel overparameterized…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Shin-Fang Chng , Ravi Garg , Hemanth Saratchandran , Simon Lucey

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue