English
Related papers

Related papers: DualSDF: Semantic Shape Manipulation using a Two-L…

200 papers

High fidelity representation of shapes with arbitrary topology is an important problem for a variety of vision and graphics applications. Owing to their limited resolution, classical discrete shape representations using point clouds, voxels…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Rahul Venkatesh , Sarthak Sharma , Aurobrata Ghosh , Laszlo Jeni , Maneesh Singh

In this paper, we present a novel double diffusion based neural radiance field, dubbed DD-NeRF, to reconstruct human body geometry and render the human body appearance in novel views from a sparse set of images. We first propose a double…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Guangming Yao , Hongzhi Wu , Yi Yuan , Lincheng Li , Kun Zhou , Xin Yu

We introduce DoubleField, a novel framework combining the merits of both surface field and radiance field for high-fidelity human reconstruction and rendering. Within DoubleField, the surface field and radiance field are associated together…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ruizhi Shao , Hongwen Zhang , He Zhang , Mingjia Chen , Yanpei Cao , Tao Yu , Yebin Liu

Implicit Neural Representations have gained prominence as a powerful framework for capturing complex data modalities, encompassing a wide range from 3D shapes to images and audio. Within the realm of 3D shape representation, Neural Signed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Amine Ouasfi , Adnane Boukhayma

Prevailing image representation methods, including explicit representations such as raster images and Gaussian primitives, as well as implicit representations such as latent images, either suffer from representation redundancy that leads to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Ye Chen , Yupeng Zhu , Xiongzhen Zhang , Zhewen Wan , Yingzhe Li , Wenjun Zhang , Bingbing Ni

SDF-based differential rendering frameworks have achieved state-of-the-art multiview 3D shape reconstruction. In this work, we re-examine this family of approaches by minimally reformulating its core appearance model in a way that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Briac Toussaint , Diego Thomas , Jean-Sébastien Franco

Geometric Deep Learning has recently made striking progress with the advent of continuous Deep Implicit Fields. They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Euclidean grid,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Edoardo Remelli , Artem Lukoianov , Stephan R. Richter , Benoît Guillard , Timur Bagautdinov , Pierre Baque , Pascal Fua

We present Gradient-SDF, a novel representation for 3D geometry that combines the advantages of implict and explicit representations. By storing at every voxel both the signed distance field as well as its gradient vector field, we enhance…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Christiane Sommer , Lu Sang , David Schubert , Daniel Cremers

We introduce a high resolution, 3D-consistent image and shape generation technique which we call StyleSDF. Our method is trained on single-view RGB data only, and stands on the shoulders of StyleGAN2 for image generation, while solving two…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Roy Or-El , Xuan Luo , Mengyi Shan , Eli Shechtman , Jeong Joon Park , Ira Kemelmacher-Shlizerman

We present learning-based implicit shape representations designed for real-time avatar collision queries arising in the simulation of clothing. Signed distance functions (SDFs) have been used for such queries for many years due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Osman Akar , Yushan Han , Yizhou Chen , Weixian Lan , Benn Gallagher , Ronald Fedkiw , Joseph Teran

Deep neural representations of 3D shapes as implicit functions have been shown to produce high fidelity models surpassing the resolution-memory trade-off faced by the explicit representations using meshes and point clouds. However, most…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Rahul Venkatesh , Tejan Karmali , Sarthak Sharma , Aurobrata Ghosh , R. Venkatesh Babu , László A. Jeni , Maneesh Singh

Efficiently reconstructing complex and intricate surfaces at scale is a long-standing goal in machine perception. To address this problem we introduce Deep Local Shapes (DeepLS), a deep shape representation that enables encoding and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Rohan Chabra , Jan Eric Lenssen , Eddy Ilg , Tanner Schmidt , Julian Straub , Steven Lovegrove , Richard Newcombe

Humans rely on their visual and tactile senses to develop a comprehensive 3D understanding of their physical environment. Recently, there has been a growing interest in exploring and manipulating objects using data-driven approaches that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Mauro Comi , Yijiong Lin , Alex Church , Alessio Tonioni , Laurence Aitchison , Nathan F. Lepora

Probabilistic diffusion models have achieved state-of-the-art results for image synthesis, inpainting, and text-to-image tasks. However, they are still in the early stages of generating complex 3D shapes. This work proposes Diffusion-SDF, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Gene Chou , Yuval Bahat , Felix Heide

Humans demonstrate remarkable skill in transferring manipulation abilities across objects of varying shapes, poses, and appearances, a capability rooted in their understanding of semantic correspondences between different instances. To…

Robotics · Computer Science 2024-03-19 Qianxu Wang , Haotong Zhang , Congyue Deng , Yang You , Hao Dong , Yixin Zhu , Leonidas Guibas

Dense reconstruction and differentiable rendering are fundamental tightly connected operations in 3D vision and computer graphics. Recent neural implicit representations demonstrate compelling advantages in reconstruction fidelity and…

Robotics · Computer Science 2026-05-25 Zhirui Dai , Hojoon Shin , Yulun Tian , Ki Myung Brian Lee , Nikolay Atanasov

Deep Implicit Functions (DIFs) have gained popularity in 3D computer vision due to their compactness and continuous representation capabilities. However, addressing dense correspondences and semantic relationships across DIF-encoded shapes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Kun Han , Shanlin Sun , Xiaohui Xie

Motivated by recent findings from cognitive neural science, we advocate the use of a dual-level model for concept representations: the embodied level consists of concept-oriented feature representations, and the symbolic level consists of…

Machine Learning · Computer Science 2022-03-02 Daniel T. Chang

Current diffusion or flow-based generative models for 3D shapes divide to two: distilling pre-trained 2D image diffusion models, and training directly on 3D shapes. When training a diffusion or flow models on 3D shapes a crucial design…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Lior Yariv , Omri Puny , Natalia Neverova , Oran Gafni , Yaron Lipman

Embedding 3D morphable basis functions into deep neural networks opens great potential for models with better representation power. However, to faithfully learn those models from an image collection, it requires strong regularization to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Luan Tran , Feng Liu , Xiaoming Liu