English
Related papers

Related papers: Volume Rendering of Neural Implicit Surfaces

200 papers

A central challenge in data visualization is to understand which data samples are required to generate an image of a data set in which the relevant information is encoded. In this work, we make a first step towards answering the question of…

Graphics · Computer Science 2021-03-12 Sebastian Weiss , Mustafa Işık , Justus Thies , Rüdiger Westermann

In recent years, novel view synthesis has gained popularity in generating high-fidelity images. While demonstrating superior performance in the task of synthesizing novel views, the majority of these methods are still based on the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Xiaoyan Yang , Dingbo Lu , Yang Li , Chenhui Li , Changbo Wang

Current volumetric biomedical foundation models struggle to generalize as public 3D datasets are small and do not cover the broad diversity of medical procedures, conditions, anatomical regions, and imaging protocols. We address this by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Neel Dey , Benjamin Billot , Hallee E. Wong , Clinton J. Wang , Mengwei Ren , P. Ellen Grant , Adrian V. Dalca , Polina Golland

Parametric human body models play a crucial role in computer graphics and vision, enabling applications ranging from human motion analysis to understanding human-environment interactions. Traditionally, these models use surface meshes,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Marko Mihajlovic , Siwei Zhang , Gen Li , Kaifeng Zhao , Lea Müller , Siyu Tang

It can be difficult to tell whether a trained generative model has learned to generate novel examples or has simply memorized a specific set of outputs. In published work, it is common to attempt to address this visually, for example by…

Machine Learning · Computer Science 2017-05-29 Matt Feiszli

Recent development of neural implicit function has shown tremendous success on high-quality 3D shape reconstruction. However, most works divide the space into inside and outside of the shape, which limits their representing power to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Jianglong Ye , Yuntao Chen , Naiyan Wang , Xiaolong Wang

4D reconstruction and rendering of human activities is critical for immersive VR/AR experience.Recent advances still fail to recover fine geometry and texture results with the level of detail present in the input images from sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Xin Suo , Yuheng Jiang , Pei Lin , Yingliang Zhang , Kaiwen Guo , Minye Wu , Lan Xu

Dense 3D reconstruction from a stream of depth images is the key to many mixed reality and robotic applications. Although methods based on Truncated Signed Distance Function (TSDF) Fusion have advanced the field over the years, the TSDF…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Kejie Li , Yansong Tang , Victor Adrian Prisacariu , Philip H. S. Torr

We introduce SparseNeuS, a novel neural rendering based method for the task of surface reconstruction from multi-view images. This task becomes more difficult when only sparse images are provided as input, a scenario where existing neural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Xiaoxiao Long , Cheng Lin , Peng Wang , Taku Komura , Wenping Wang

Representing visual signals by implicit representation (e.g., a coordinate based deep network) has prevailed among many vision tasks. This work explores a new intriguing direction: training a stylized implicit representation, using a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zhiwen Fan , Yifan Jiang , Peihao Wang , Xinyu Gong , Dejia Xu , Zhangyang Wang

Implicit neural representation is a recent approach to learn shape collections as zero level-sets of neural networks, where each shape is represented by a latent code. So far, the focus has been shape reconstruction, while shape…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Matan Atzmon , David Novotny , Andrea Vedaldi , Yaron Lipman

High fidelity representation of shapes with arbitrary topology is an important problem for a variety of vision and graphics applications. Owing to their limited resolution, classical discrete shape representations using point clouds, voxels…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Rahul Venkatesh , Sarthak Sharma , Aurobrata Ghosh , Laszlo Jeni , Maneesh Singh

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua , Christian Theobalt

Neural Radiance Fields (NeRF) have constituted a remarkable breakthrough in image-based 3D reconstruction. However, their implicit volumetric representations differ significantly from the widely-adopted polygonal meshes and lack support…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jiaxiang Tang , Hang Zhou , Xiaokang Chen , Tianshu Hu , Errui Ding , Jingdong Wang , Gang Zeng

In recent years, neural implicit surface reconstruction has emerged as a popular paradigm for multi-view 3D reconstruction. Unlike traditional multi-view stereo approaches, the neural implicit surface-based methods leverage neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Qianyi Wu , Kaisiyuan Wang , Kejie Li , Jianmin Zheng , Jianfei Cai

We present a novel online depth map fusion approach that learns depth map aggregation in a latent feature space. While previous fusion methods use an explicit scene representation like signed distance functions (SDFs), we propose a learned…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Silvan Weder , Johannes L. Schönberger , Marc Pollefeys , Martin R. Oswald

In recent years, neural distance functions trained via volumetric ray marching have been widely adopted for multi-view 3D reconstruction. These methods, however, apply the ray marching procedure for the entire scene volume, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Andreea Dogaru , Andrei Timotei Ardelean , Savva Ignatyev , Egor Zakharov , Evgeny Burnaev

Non-line-of-sight (NLOS) imaging is conducted to infer invisible scenes from indirect light on visible objects. The neural transient field (NeTF) was proposed for representing scenes as neural radiance fields in NLOS scenes. We propose NLOS…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Yuki Fujimura , Takahiro Kushida , Takuya Funatomi , Yasuhiro Mukaigawa

Three-dimensional (3D) freehand ultrasound (US) is a widely used imaging modality that allows non-invasive imaging of medical anatomy without radiation exposure. Surface reconstruction of US volume is vital to acquire the accurate…

High-quality view synthesis relies on volume rendering, splatting, or surface rendering. While surface rendering is typically the fastest, it struggles to accurately model fuzzy geometry like hair. In turn, alpha-blending techniques excel…