English
Related papers

Related papers: Enhancing Neural Rendering Methods with Image Augm…

200 papers

This paper introduces a novel paradigm for the generalizable neural radiance field (NeRF). Previous generic NeRF methods combine multiview stereo techniques with image-based neural rendering for generalization, yielding impressive results,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Jiaxu Wang , Ziyi Zhang , Renjing Xu

Current methods based on Neural Radiance Fields fail in the low data limit, particularly when training on incomplete scene data. Prior works augment training data only in next-best-view applications, which lead to hallucinations and model…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ayush Gaggar , Todd D. Murphey

In this work we address the challenging problem of multiview 3D surface reconstruction. We introduce a neural network architecture that simultaneously learns the unknown geometry, camera parameters, and a neural renderer that approximates…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Lior Yariv , Yoni Kasten , Dror Moran , Meirav Galun , Matan Atzmon , Ronen Basri , Yaron Lipman

Rendering novel view images is highly desirable for many applications. Despite recent progress, it remains challenging to render high-fidelity and view-consistent novel views of large-scale scenes from in-the-wild images with inevitable…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Peng Dai , Yinda Zhang , Xin Yu , Xiaoyang Lyu , Xiaojuan Qi

Online reconstructing and rendering of large-scale indoor scenes is a long-standing challenge. SLAM-based methods can reconstruct 3D scene geometry progressively in real time but can not render photorealistic results. While NeRF-based…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yiming Gao , Yan-Pei Cao , Ying Shan

We introduce an improved solution to the neural image-based rendering problem in computer vision. Given a set of images taken from a freely moving camera at train time, the proposed approach could synthesize a realistic image of the scene…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Nishant Jain , Suryansh Kumar , Luc Van Gool

Data augmentation is one of the most effective techniques to improve the generalization performance of deep neural networks. Yet, despite often facing limited data availability in medical image analysis, it is frequently underutilized. This…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Adam Tupper , Christian Gagné

Data augmentation is an effective way to improve the performance of deep networks. Unfortunately, current methods are mostly developed for high-level vision tasks (e.g., classification) and few are studied for low-level vision tasks (e.g.,…

Image and Video Processing · Electrical Eng. & Systems 2020-04-24 Jaejun Yoo , Namhyuk Ahn , Kyung-Ah Sohn

Data augmentations have been widely studied to improve the accuracy and robustness of classifiers. However, the potential of image augmentation in improving GAN models for image synthesis has not been thoroughly investigated in previous…

Machine Learning · Computer Science 2020-06-05 Zhengli Zhao , Zizhao Zhang , Ting Chen , Sameer Singh , Han Zhang

Recent work has demonstrated that volumetric scene representations combined with differentiable volume rendering can enable photo-realistic rendering for challenging scenes that mesh reconstruction fails on. However, these methods entangle…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Fanbo Xiang , Zexiang Xu , Miloš Hašan , Yannick Hold-Geoffroy , Kalyan Sunkavalli , Hao Su

We present a framework, called MVG-NeRF, that combines classical Multi-View Geometry algorithms and Neural Radiance Fields (NeRF) for image-based 3D reconstruction. NeRF has revolutionized the field of implicit 3D representations, mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Marco Orsingher , Paolo Zani , Paolo Medici , Massimo Bertozzi

We present a method for the accurate 3D reconstruction of partly-symmetric objects. We build on the strengths of recent advances in neural reconstruction and rendering such as Neural Radiance Fields (NeRF). A major shortcoming of such…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Eldar Insafutdinov , Dylan Campbell , João F. Henriques , Andrea Vedaldi

Driving scenes are extremely diverse and complicated that it is impossible to collect all cases with human effort alone. While data augmentation is an effective technique to enrich the training data, existing methods for camera data in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Wenwen Tong , Jiangwei Xie , Tianyu Li , Hanming Deng , Xiangwei Geng , Ruoyi Zhou , Dingchen Yang , Bo Dai , Lewei Lu , Hongyang Li

Image registration is a fundamental task for medical imaging. Resampling of the intensity values is required during registration and better spatial resolution with finer and sharper structures can improve the resampling performance and…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Kaicong Sun , Sven Simon

Inverse rendering aims to reconstruct the scene properties of objects solely from multiview images. However, it is an ill-posed problem prone to producing ambiguous estimations deviating from physically accurate representations. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Georgios Kouros , Minye Wu , Sushruth Nagesh , Xianling Zhang , Tinne Tuytelaars

Recent research on learnable neural representations has been widely adopted in the field of 3D scene reconstruction and neural rendering applications. However, traditional feature grid representations often suffer from substantial memory…

Graphics · Computer Science 2026-04-30 Rui Su , Honghao Dong , Haojie Jin , Yisong Chen , Guoping Wang , Sheng Li

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

It is difficult to collect data on a large scale in a monocular depth estimation because the task requires the simultaneous acquisition of RGB images and depths. Data augmentation is thus important to this task. However, there has been…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Yasunori Ishii , Takayoshi Yamashita

The success of deep learning depends heavily on the availability of large datasets, but in robotic manipulation there are many learning problems for which such datasets do not exist. Collecting these datasets is time-consuming and…

Robotics · Computer Science 2022-07-21 Peter Mitrano , Dmitry Berenson