English
Related papers

Related papers: Neural Volume Super-Resolution

200 papers

We consider the problem of scaling deep generative shape models to high-resolution. Drawing motivation from the canonical view representation of objects, we introduce a novel method for the fast up-sampling of 3D objects in voxel space…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Edward Smith , Scott Fujimoto , David Meger

Most existing super-resolution methods do not perform well in real scenarios due to lack of realistic training data and information loss of the model input. To solve the first problem, we propose a new pipeline to generate realistic…

Image and Video Processing · Electrical Eng. & Systems 2019-05-30 Xiangyu Xu , Yongrui Ma , Wenxiu Sun

Volumetric neural rendering methods like NeRF generate high-quality view synthesis results but are optimized per-scene leading to prohibitive reconstruction time. On the other hand, deep multi-view stereo methods can quickly reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Qiangeng Xu , Zexiang Xu , Julien Philip , Sai Bi , Zhixin Shu , Kalyan Sunkavalli , Ulrich Neumann

Neural Radiance Fields (NeRFs) are a very recent and very popular approach for the problems of novel view synthesis and 3D reconstruction. A popular scene representation used by NeRFs is to combine a uniform, voxel-based subdivision of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jonas Kulhanek , Torsten Sattler

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

We present a super-resolution method capable of creating a high-resolution texture map for a virtual 3D object from a set of lower-resolution images of that object. Our architecture unifies the concepts of (i) multi-view super-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Audrey Richard , Ian Cherabier , Martin R. Oswald , Vagia Tsiminaki , Marc Pollefeys , Konrad Schindler

Super-resolution is a fundamental problem in computer vision which aims to overcome the spatial limitation of camera sensors. While significant progress has been made in single image super-resolution, most algorithms only perform well on…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Xiangyu Xu , Yongrui Ma , Wenxiu Sun , Ming-Hsuan Yang

With the advent of deep neural networks, learning-based approaches for 3D reconstruction have gained popularity. However, unlike for images, in 3D there is no canonical representation which is both computationally and memory efficient yet…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Lars Mescheder , Michael Oechsle , Michael Niemeyer , Sebastian Nowozin , Andreas Geiger

Since the advent of Neural Radiance Fields, novel view synthesis has received tremendous attention. The existing approach for the generalization of radiance field reconstruction primarily constructs an encoding volume from nearby source…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Jingliang Li , Qiang Zhou , Chaohui Yu , Zhengda Lu , Jun Xiao , Zhibin Wang , Fan Wang

Recently neural volumetric representations such as neural reflectance fields have been widely applied to faithfully reproduce the appearance of real-world objects and scenes under novel viewpoints and lighting conditions. However, it…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Mohammad Shafiei , Sai Bi , Zhengqin Li , Aidas Liaudanskas , Rodrigo Ortiz-Cayon , Ravi Ramamoorthi

Despite the potential of neural scene representations to effectively compress 3D scalar fields at high reconstruction quality, the computational complexity of the training and data reconstruction step using scene representation networks…

Graphics · Computer Science 2022-07-26 Sebastian Weiss , Philipp Hermüller , Rüdiger Westermann

In this paper, we study the problem of continuous 3D shape representations. The majority of existing successful methods are coordinate-based implicit neural representations. However, they are inefficient to render novel views or recover…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhuoman Liu , Bo Yang , Yan Luximon , Ajay Kumar , Jinxi Li

We propose and evaluate a neural point-based graphics method that can model semi-transparent scene parts. Similarly to its predecessor pipeline, ours uses point clouds to model proxy geometry, and augments each point with a neural…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Maria Kolos , Artem Sevastopolsky , Victor Lempitsky

Domain scientists often face I/O and storage challenges when keeping raw data from large-scale simulations. Saving visualization images, albeit practical, is limited to preselected viewpoints, transfer functions, and simulation parameters.…

Graphics · Computer Science 2025-02-25 Siyuan Yao , Yunfei Lu , Chaoli Wang

We present a method, Neural Radiance Flow (NeRFlow),to learn a 4D spatial-temporal representation of a dynamic scene from a set of RGB images. Key to our approach is the use of a neural implicit representation that learns to capture the 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Yilun Du , Yinan Zhang , Hong-Xing Yu , Joshua B. Tenenbaum , Jiajun Wu

Rendering novel view images is highly desirable for many applications. Despite recent progress, it remains challenging to render high-fidelity and view-consistent novel views of large-scale scenes from in-the-wild images with inevitable…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Peng Dai , Yinda Zhang , Xin Yu , Xiaoyang Lyu , Xiaojuan Qi

Dynamic imaging is essential for analyzing various biological systems and behaviors but faces two main challenges: data incompleteness and computational burden. For many imaging systems, high frame rates and short acquisition times require…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Luke Lozenski , Mark A. Anastasio , Umberto Villa

This paper introduces a novel representation of volumetric videos for real-time view synthesis of dynamic scenes. Recent advances in neural scene representations demonstrate their remarkable capability to model and render complex static…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Sida Peng , Yunzhi Yan , Qing Shuai , Hujun Bao , Xiaowei Zhou

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

We propose a novel Neural Radiance Field (NeRF) representation for non-opaque scenes that enables fast inference by utilizing textured polygons. Despite the high-quality novel view rendering that NeRF provides, a critical limitation is that…

Graphics · Computer Science 2024-07-11 Gopal Sharma , Daniel Rebain , Kwang Moo Yi , Andrea Tagliasacchi