English
Related papers

Related papers: Neural Image Representations for Multi-Image Fusio…

200 papers

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Ashkan Mirzaei , Tristan Aumentado-Armstrong , Konstantinos G. Derpanis , Jonathan Kelly , Marcus A. Brubaker , Igor Gilitschenski , Alex Levinshtein

Neural Radiance Fields (NeRF) achieves photo-realistic image rendering from novel views, and the Neural Scene Graphs (NSG) \cite{ost2021neural} extends it to dynamic scenes (video) with multiple objects. Nevertheless, computationally heavy…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yeji Song , Chaerin Kong , Seoyoung Lee , Nojun Kwak , Joonseok Lee

In recent years, the paradigm of neural implicit representations has gained substantial attention in the field of Simultaneous Localization and Mapping (SLAM). However, a notable gap exists in the existing approaches when it comes to scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Hongjia Zhai , Gan Huang , Qirui Hu , Guanglin Li , Hujun Bao , Guofeng Zhang

In many computer vision applications, images are acquired with arbitrary or random rotations and translations, and in such setups, it is desirable to obtain semantic representations disentangled from the image orientation. Examples of such…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Sehyun Kwon , Joo Young Choi , Ernest K. Ryu

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Recent implicit neural representations have shown great results for novel view synthesis. However, existing methods require expensive per-scene optimization from many views hence limiting their application to real-world unbounded urban…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Muhammad Zubair Irshad , Sergey Zakharov , Katherine Liu , Vitor Guizilini , Thomas Kollar , Adrien Gaidon , Zsolt Kira , Rares Ambrus

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dario Pavllo , David Joseph Tan , Marie-Julie Rakotosaona , Federico Tombari

Optical imaging through complex media, such as biological tissues or fog, is challenging due to light scattering. In the multiple scattering regime, wavefront shaping provides an effective method to retrieve information; it relies on…

Implicit neural representation (INR) embed various signals into neural networks. They have gained attention in recent years because of their versatility in handling diverse signal types. In the context of video, INR achieves video…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Taiga Hayami , Takahiro Shindo , Shunsuke Akamatsu , Hiroshi Watanabe

In this paper we reexamine the process through which a Neural Radiance Field (NeRF) can be trained to produce novel LiDAR views of a scene. Unlike image applications where camera pixels integrate light over time, LiDAR pulses arrive at…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Matthew McDermott , Jason Rife

Multi-camera setups find widespread use across various applications, such as autonomous driving, as they greatly expand sensing capabilities. Despite the fast development of Neural radiance field (NeRF) techniques and their wide…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Kai Cheng , Xiaoxiao Long , Wei Yin , Jin Wang , Zhiqiang Wu , Yuexin Ma , Kaixuan Wang , Xiaozhi Chen , Xuejin Chen

Implicit neural representations have shown compelling results in offline 3D reconstruction and also recently demonstrated the potential for online SLAM systems. However, applying them to autonomous 3D reconstruction, where a robot is…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Yunlong Ran , Jing Zeng , Shibo He , Lincheng Li , Yingfeng Chen , Gimhee Lee , Jiming Chen , Qi Ye

Optical sensor applications have become popular through digital transformation. Linking observed data to real-world locations and combining different image sensors is essential to make the applications practical and efficient. However, data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Kana Kurata , Hitoshi Niigaki , Xiaojun Wu , Ryuichi Tanida

Identifying changes in a pair of 3D aerial LiDAR point clouds, obtained during two distinct time periods over the same geographic region presents a significant challenge due to the disparities in spatial coverage and the presence of noise…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Peter Naylor , Diego Di Carlo , Arianna Traviglia , Makoto Yamada , Marco Fiorucci

We propose a neural inverse rendering approach that jointly reconstructs geometry, spatially varying reflectance, and lighting conditions from multi-view images captured under varying directional lighting. Unlike prior multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Xu Cao , Takafumi Taketomi

Neural reconstruction models for autonomous driving simulation have made significant strides in recent years, with dynamic models becoming increasingly prevalent. However, these models are typically limited to handling in-domain objects…

Clinical routine and retrospective cohorts commonly include multi-parametric Magnetic Resonance Imaging; however, they are mostly acquired in different anisotropic 2D views due to signal-to-noise-ratio and scan-time constraints. Thus…

Neural networks have recently been used to analyze diverse physical systems and to identify the underlying dynamics. While existing methods achieve impressive results, they are limited by their strong demand for training data and their weak…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Florian Hofherr , Lukas Koestler , Florian Bernard , Daniel Cremers