English
Related papers

Related papers: Learning Neural Implicit through Volume Rendering …

200 papers

Representing visual signals by implicit representation (e.g., a coordinate based deep network) has prevailed among many vision tasks. This work explores a new intriguing direction: training a stylized implicit representation, using a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zhiwen Fan , Yifan Jiang , Peihao Wang , Xinyu Gong , Dejia Xu , Zhangyang Wang

Implicit Neural Representations have gained prominence as a powerful framework for capturing complex data modalities, encompassing a wide range from 3D shapes to images and audio. Within the realm of 3D shape representation, Neural Signed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Amine Ouasfi , Adnane Boukhayma

In recent years, neural implicit surface reconstruction has emerged as a popular paradigm for multi-view 3D reconstruction. Unlike traditional multi-view stereo approaches, the neural implicit surface-based methods leverage neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Qianyi Wu , Kaisiyuan Wang , Kejie Li , Jianmin Zheng , Jianfei Cai

Modeling scene geometry using implicit neural representation has revealed its advantages in accuracy, flexibility, and low memory usage. Previous approaches have demonstrated impressive results using color or depth images but still have…

Robotics · Computer Science 2023-03-01 Dongyu Yan , Xiaoyang Lyu , Jieqi Shi , Yi Lin

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

Decoding visual representations from brain signals has attracted significant attention in both neuroscience and artificial intelligence. However, the degree to which brain signals truly encode visual information remains unclear. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jiawen Zheng , Haonan Jia , Ming Li , Yuhui Zheng , Yufeng Zeng , Yang Gao , Chen Liang

Neural reconstruction and rendering strategies have demonstrated state-of-the-art performances due, in part, to their ability to preserve high level shape details. Existing approaches, however, either represent objects as implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Angtian Wang , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Edmond Boyer , Alan Yuille , Tony Tung

Current 3D-aware pretraining methods for embodied perception and manipulation are largely built on differentiable rendering frameworks, producing either fully implicit neural fields or fully explicit geometric primitives. Implicit…

Neural implicit surface representations have recently emerged as popular alternative to explicit 3D object encodings, such as polygonal meshes, tabulated points, or voxels. While significant work has improved the geometric fidelity of these…

Graphics · Computer Science 2023-06-27 Yanran Guan , Andrei Chubarau , Ruby Rao , Derek Nowrouzezahrai

Neural implicit surface reconstruction with signed distance function has made significant progress, but recovering fine details such as thin structures and complex geometries remains challenging due to unreliable or noisy geometric priors.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Qiyu Feng , Jiwei Shan , Shing Shin Cheng , Hesheng Wang

Deep neural representations of 3D shapes as implicit functions have been shown to produce high fidelity models surpassing the resolution-memory trade-off faced by the explicit representations using meshes and point clouds. However, most…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Rahul Venkatesh , Tejan Karmali , Sarthak Sharma , Aurobrata Ghosh , R. Venkatesh Babu , László A. Jeni , Maneesh Singh

Neural implicit representations, which encode a surface as the level set of a neural network applied to spatial coordinates, have proven to be remarkably effective for optimizing, compressing, and generating 3D geometry. Although these…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Nicholas Sharp , Alec Jacobson

In recent years, huge progress has been made on learning neural implicit representations from multi-view images for 3D reconstruction. As an additional input complementing coordinates, using sinusoidal functions as positional encodings…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Sijia Jiang , Jing Hua , Zhizhong Han

We propose a new deep learning architecture for the tasks of semantic segmentation and depth prediction from RGB-D images. We revise the state of art based on the RGB and depth feature fusion, where both modalities are assumed to be…

Artificial Intelligence · Computer Science 2018-12-18 Giorgio Giannone , Boris Chidlovskii

In the field of monocular 3D detection, it is common practice to utilize scene geometric clues to enhance the detector's performance. However, many existing works adopt these clues explicitly such as estimating a depth map and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Junkai Xu , Liang Peng , Haoran Cheng , Hao Li , Wei Qian , Ke Li , Wenxiao Wang , Deng Cai

Recovering detailed facial geometry from a set of calibrated multi-view images is valuable for its wide range of applications. Traditional multi-view stereo (MVS) methods adopt an optimization-based scheme to regularize the matching cost.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yunze Xiao , Hao Zhu , Haotian Yang , Zhengyu Diao , Xiangju Lu , Xun Cao

Recently, implicit neural representations have gained popularity for learning-based 3D reconstruction. While demonstrating promising results, most implicit approaches are limited to comparably simple geometry of single objects and do not…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Songyou Peng , Michael Niemeyer , Lars Mescheder , Marc Pollefeys , Andreas Geiger

Recovering the scene depth from a single image is an ill-posed problem that requires additional priors, often referred to as monocular depth cues, to disambiguate different 3D interpretations. In recent works, those priors have been learned…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Lam Huynh , Phong Nguyen-Ha , Jiri Matas , Esa Rahtu , Janne Heikkila

Mobile robots operating indoors must be prepared to navigate challenging scenes that contain transparent surfaces. This paper proposes a novel method for the fusion of acoustic and visual sensing modalities through implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Advaith V. Sethuraman , Onur Bagoren , Harikrishnan Seetharaman , Dalton Richardson , Joseph Taylor , Katherine A. Skinner

Volume Rendering is an important technique for visualizing three-dimensional scalar data grids and is commonly employed for scientific and medical image data. Direct Volume Rendering (DVR) is a well established and efficient rendering…

Graphics · Computer Science 2021-06-11 Jakob Weiss , Nassir Navab