English
Related papers

Related papers: MagicClay: Sculpting Meshes With Generative Neural…

200 papers

Obtaining personalized 3D animatable avatars from a monocular camera has several real world applications in gaming, virtual try-on, animation, and VR/XR, etc. However, it is very challenging to model dynamic and fine-grained clothing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yuxuan Xue , Bharat Lal Bhatnagar , Riccardo Marin , Nikolaos Sarafianos , Yuanlu Xu , Gerard Pons-Moll , Tony Tung

The neural radiance field (NERF) advocates learning the continuous representation of 3D geometry through a multilayer perceptron (MLP). By integrating this into a generative model, the generative neural radiance field (GRAF) is capable of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Jian Liu , Zhen Yu

Neural implicit reconstruction via volume rendering has demonstrated its effectiveness in recovering dense 3D surfaces. However, it is non-trivial to simultaneously recover meticulous geometry and preserve smoothness across regions with…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Ziyu Tang , Weicai Ye , Yifan Wang , Di Huang , Hujun Bao , Tong He , Guofeng Zhang

We introduce a new generative approach for synthesizing 3D geometry and images from single-view collections. Most existing approaches predict volumetric density to render multi-view consistent images. By employing volumetric rendering using…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Salvatore Esposito , Qingshan Xu , Kacper Kania , Charlie Hewitt , Octave Mariotti , Lohit Petikam , Julien Valentin , Arno Onken , Oisin Mac Aodha

Triangle meshes play a crucial role in 3D applications for efficient manipulation and rendering. While auto-regressive methods generate structured meshes by predicting discrete vertex tokens, they are often constrained by limited face…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Ruowen Zhao , Junliang Ye , Zhengyi Wang , Guangce Liu , Yiwen Chen , Yikai Wang , Jun Zhu

We present a method for learning 3D geometry and physics parameters of a dynamic scene from only a monocular RGB video input. To decouple the learning of underlying scene geometry from dynamic motion, we represent the scene as a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Yi-Ling Qiao , Alexander Gao , Ming C. Lin

Neural volume rendering became increasingly popular recently due to its success in synthesizing novel views of a scene from a sparse set of input images. So far, the geometry learned by neural volume rendering techniques was modeled using a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Lior Yariv , Jiatao Gu , Yoni Kasten , Yaron Lipman

Neural implicit fields have recently emerged as a useful representation for 3D shapes. These fields are commonly represented as neural networks which map latent descriptors and 3D coordinates to implicit function values. The latent…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Hsueh-Ti Derek Liu , Francis Williams , Alec Jacobson , Sanja Fidler , Or Litany

Effective representation of 2D images is fundamental in digital image processing, where traditional methods like raster and vector graphics struggle with sharpness and textural complexity respectively. Current neural fields offer…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Chenxi Liu , Siqi Wang , Matthew Fisher , Deepali Aneja , Alec Jacobson

In this paper, we study the problem of continuous 3D shape representations. The majority of existing successful methods are coordinate-based implicit neural representations. However, they are inefficient to render novel views or recover…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhuoman Liu , Bo Yang , Yan Luximon , Ajay Kumar , Jinxi Li

This paper presents Neural Mesh Fusion (NMF), an efficient approach for joint optimization of polygon mesh from multi-view image observations and unsupervised 3D planar-surface parsing of the scene. In contrast to implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Farhad G. Zanjani , Hong Cai , Yinhao Zhu , Leyla Mirvakhabova , Fatih Porikli

Meshes serve as a primary representation for 3D assets. Autoregressive mesh generators serialize faces into sequences and train on truncated segments with sliding-window inference to cope with memory limits. However, this mismatch breaks…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Junkai Lin , Hang Long , Huipeng Guo , Jielei Zhang , JiaYi Yang , Tianle Guo , Yang Yang , Jianwen Li , Wenxiao Zhang , Matthias Nießner , Wei Yang

The field of computer graphics was revolutionized by models such as Neural Radiance Fields and 3D Gaussian Splatting, displacing triangles as the dominant representation for photogrammetry. In this paper, we argue for a triangle comeback.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jan Held , Renaud Vandeghen , Adrien Deliege , Abdullah Hamdi , Silvio Giancola , Anthony Cioppa , Andrea Vedaldi , Bernard Ghanem , Andrea Tagliasacchi , Marc Van Droogenbroeck

We present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Guocheng Qian , Jinjie Mai , Abdullah Hamdi , Jian Ren , Aliaksandr Siarohin , Bing Li , Hsin-Ying Lee , Ivan Skorokhodov , Peter Wonka , Sergey Tulyakov , Bernard Ghanem

Current diffusion or flow-based generative models for 3D shapes divide to two: distilling pre-trained 2D image diffusion models, and training directly on 3D shapes. When training a diffusion or flow models on 3D shapes a crucial design…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Lior Yariv , Omri Puny , Natalia Neverova , Oran Gafni , Yaron Lipman

We present a method to automatically compute correct gradients with respect to geometric scene parameters in neural SDF renderers. Recent physically-based differentiable rendering techniques for meshes have used edge-sampling to handle…

Neural fields, a category of neural networks trained to represent high-frequency signals, have gained significant attention in recent years due to their impressive performance in modeling complex 3D data, such as signed distance (SDFs) or…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Marko Mihajlovic , Sergey Prokudin , Marc Pollefeys , Siyu Tang

Combining accurate geometry with rich semantics has been proven to be highly effective for language-guided robotic manipulation. Existing methods for dynamic scenes either fail to update in real-time or rely on additional depth sensors for…

Robotics · Computer Science 2024-10-22 Yu Sheng , Runfeng Lin , Lidian Wang , Quecheng Qiu , YanYong Zhang , Yu Zhang , Bei Hua , Jianmin Ji

Implicit neural representations have emerged as a powerful approach for encoding complex geometries as continuous functions. These implicit models are widely used in computer vision and 3D content creation, but their integration into…

Implicit neural representations have emerged as a powerful tool in learning 3D geometry, offering unparalleled advantages over conventional representations like mesh-based methods. A common type of INR implicitly encodes a shape's boundary…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Shen Fan , Przemyslaw Musialski