English
Related papers

Related papers: NeuMesh: Learning Disentangled Neural Mesh-based I…

200 papers

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

The question of representation of 3D geometry is of vital importance when it comes to leveraging the recent advances in the field of machine learning for geometry processing tasks. For common unstructured surface meshes state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Isaak Lim , Alexander Dielen , Marcel Campen , Leif Kobbelt

Recent works on implicit neural representations have made significant strides. Learning implicit neural surfaces using volume rendering has gained popularity in multi-view reconstruction without 3D supervision. However, accurately…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Decai Chen , Peng Zhang , Ingo Feldmann , Oliver Schreer , Peter Eisert

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua , Christian Theobalt

The widespread adoption of implicit neural representations, especially Neural Radiance Fields (NeRF), highlights a growing need for editing capabilities in implicit 3D models, essential for tasks like scene post-processing and 3D content…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Zhentao Huang , Yukun Shi , Neil Bruce , Minglun Gong

Visual localization techniques rely upon some underlying scene representation to localize against. These representations can be explicit such as 3D SFM map or implicit, such as a neural network that learns to encode the scene. The former…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Maxime Pietrantoni , Gabriela Csurka , Martin Humenberger , Torsten Sattler

We propose DiMeR, a novel geometry-texture disentangled feed-forward model with 3D supervision for sparse-view mesh reconstruction. Existing methods confront two persistent obstacles: (i) textures can conceal geometric errors, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Lutao Jiang , Jiantao Lin , Kanghao Chen , Wenhang Ge , Xin Yang , Yifan Jiang , Yuanhuiyi Lyu , Xu Zheng , Yinchuan Li , Yingcong Chen

We present a method for generating high-quality watertight manifold meshes from multi-view input images. Existing volumetric rendering methods are robust in optimization but tend to generate noisy meshes with poor topology. Differentiable…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Xinyue Wei , Fanbo Xiang , Sai Bi , Anpei Chen , Kalyan Sunkavalli , Zexiang Xu , Hao Su

Neural shape models can represent complex 3D shapes with a compact latent space. When applied to dynamically deforming shapes such as the human hands, however, they would need to preserve temporal coherence of the deformation as well as the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Binbin Xu , Lingni Ma , Yuting Ye , Tanner Schmidt , Christopher D. Twigg , Steven Lovegrove

Precise representations of 3D faces are beneficial to various computer vision and graphics applications. Due to the data discretization and model linearity, however, it remains challenging to capture accurate identity and expression clues…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Mingwu Zheng , Hongyu Yang , Di Huang , Liming Chen

We present a novel neural surface reconstruction method called NeuralRoom for reconstructing room-sized indoor scenes directly from a set of 2D images. Recently, implicit neural representations have become a promising way to reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yusen Wang , Zongcheng Li , Yu Jiang , Kaixuan Zhou , Tuo Cao , Yanping Fu , Chunxia Xiao

Recent point-based differentiable rendering techniques have achieved significant success in high-fidelity reconstruction and fast rendering. However, due to the unstructured nature of point-based representations, they are difficult to apply…

Graphics · Computer Science 2025-08-12 Kaiwen Song , Jinkai Cui , Zherui Qiu , Juyong Zhang

High-quality reconstruction of controllable 3D head avatars from 2D videos is highly desirable for virtual human applications in movies, games, and telepresence. Neural implicit fields provide a powerful representation to model 3D head…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Chuhan Chen , Matthew O'Toole , Gaurav Bharaj , Pablo Garrido

Neural volume rendering became increasingly popular recently due to its success in synthesizing novel views of a scene from a sparse set of input images. So far, the geometry learned by neural volume rendering techniques was modeled using a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Lior Yariv , Jiatao Gu , Yoni Kasten , Yaron Lipman

Geometric Deep Learning has recently made striking progress with the advent of continuous Deep Implicit Fields. They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Euclidean grid,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Edoardo Remelli , Artem Lukoianov , Stephan R. Richter , Benoît Guillard , Timur Bagautdinov , Pierre Baque , Pascal Fua

Recent facial image synthesis methods have been mainly based on conditional generative models. Sketch-based conditions can effectively describe the geometry of faces, including the contours of facial components, hair structures, as well as…

Graphics · Computer Science 2021-07-20 Shu-Yu Chen , Feng-Lin Liu , Yu-Kun Lai , Paul L. Rosin , Chunpeng Li , Hongbo Fu , Lin Gao

Recent advancements in diffusion models have shown remarkable proficiency in editing 2D images based on text prompts. However, extending these techniques to edit scenes in Neural Radiance Fields (NeRF) is complex, as editing individual 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Sara Rojas , Julien Philip , Kai Zhang , Sai Bi , Fujun Luan , Bernard Ghanem , Kalyan Sunkavall

With the popularity of implicit neural representations, or neural radiance fields (NeRF), there is a pressing need for editing methods to interact with the implicit 3D models for tasks like post-processing reconstructed scenes and 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Xiangyu Wang , Jingsen Zhu , Qi Ye , Yuchi Huo , Yunlong Ran , Zhihua Zhong , Jiming Chen

High fidelity representation of shapes with arbitrary topology is an important problem for a variety of vision and graphics applications. Owing to their limited resolution, classical discrete shape representations using point clouds, voxels…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Rahul Venkatesh , Sarthak Sharma , Aurobrata Ghosh , Laszlo Jeni , Maneesh Singh

Neural implicit surfaces have become an important technique for multi-view 3D reconstruction but their accuracy remains limited. In this paper, we argue that this comes from the difficulty to learn and render high frequency textures with…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 François Darmon , Bénédicte Bascle , Jean-Clément Devaux , Pascal Monasse , Mathieu Aubry