English
Related papers

Related papers: Native and Compact Structured Latents for 3D Gener…

200 papers

3D generation has witnessed significant advancements, yet efficiently producing high-quality 3D assets from a single image remains challenging. In this paper, we present a triplane autoencoder, which encodes 3D models into a compact…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Bowen Zhang , Tianyu Yang , Yu Li , Lei Zhang , Xi Zhao

This paper proposes ShapeShifter, a new 3D generative model that learns to synthesize shape variations based on a single reference model. While generative methods for 3D objects have recently attracted much attention, current techniques…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Nissim Maruani , Wang Yifan , Matthew Fisher , Pierre Alliez , Mathieu Desbrun

This paper introduces a generative model for 3D surfaces based on a representation of shapes with mean curvature and metric, which are invariant under rigid transformation. Hence, compared with existing 3D machine learning frameworks, our…

Graphics · Computer Science 2020-09-08 Zi Ye , Nobuyuki Umetani , Takeo Igarashi , Tim Hoffmann

We propose a probabilistic shape completion method extended to the continuous geometry of large-scale 3D scenes. Real-world scans of 3D scenes suffer from a considerable amount of missing data cluttered with unsegmented objects. The problem…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Dongsu Zhang , Changwoon Choi , Inbum Park , Young Min Kim

Constructing a compressed latent space through a variational autoencoder (VAE) is the key for efficient 3D diffusion models. This paper introduces COD-VAE that encodes 3D shapes into a COmpact set of 1D latent vectors without sacrificing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 In Cho , Youngbeom Yoo , Subin Jeon , Seon Joo Kim

3D object recognition accuracy can be improved by learning the multi-scale spatial features from 3D spatial geometric representations of objects such as point clouds, 3D models, surfaces, and RGB-D data. Current deep learning approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Sambit Ghadai , Xian Lee , Aditya Balu , Soumik Sarkar , Adarsh Krishnamurthy

Recent 3D content generation pipelines often leverage Variational Autoencoders (VAEs) to encode shapes into compact latent representations, facilitating diffusion-based generation. Efficiently compressing 3D shapes while preserving…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jingyu Guo , Sensen Gao , Jia-Wang Bian , Wanhu Sun , Heliang Zheng , Rongfei Jia , Mingming Gong

This paper introduces a novel hierarchical autoencoder that maps 3D models into a highly compressed latent space. The hierarchical autoencoder is specifically designed to tackle the challenges arising from large-scale datasets and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Biao Zhang , Peter Wonka

Learning compact and meaningful latent space representations has been shown to be very useful in generative modeling tasks for visual data. One particular example is applying Vector Quantization (VQ) in variational autoencoders (VQ-VAEs,…

Machine Learning · Computer Science 2024-09-18 Xin Li , Anand Sarwate

We introduce a deep recursive octree network for the compression of 3D voxel data. Our network compresses a voxel grid of any size down to a very small latent space in an autoencoder-like network. We show results for compressing 32, 64 and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Juncheng Liu , Steven Mills , Brendan McCane

Generating high-quality 3D assets from text and images has long been challenging, primarily due to the absence of scalable 3D representations capable of capturing intricate geometry distributions. In this work, we introduce Direct3D, a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Shuang Wu , Youtian Lin , Feihu Zhang , Yifei Zeng , Jingxi Xu , Philip Torr , Xun Cao , Yao Yao

This paper presents a new approach for 3D shape generation, enabling direct generative modeling on a continuous implicit representation in wavelet domain. Specifically, we propose a compact wavelet representation with a pair of coarse and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Ka-Hei Hui , Ruihui Li , Jingyu Hu , Chi-Wing Fu

We propose a data-driven 3D shape design method that can learn a generative model from a corpus of existing designs, and use this model to produce a wide range of new designs. The approach learns an encoding of the samples in the training…

We introduce 3DShape2VecSet, a novel shape representation for neural fields designed for generative diffusion models. Our shape representation can encode 3D shapes given as surface models or point clouds, and represents them as neural…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Biao Zhang , Jiapeng Tang , Matthias Niessner , Peter Wonka

Prevailing 3D texture generation methods, which often rely on multi-view fusion, are frequently hindered by inter-view inconsistencies and incomplete coverage of complex surfaces, limiting the fidelity and completeness of the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yifei Zeng , Yajie Bao , Jiachen Qian , Shuang Wu , Youtian Lin , Hao Zhu , Buyu Li , Feihu Zhang , Xun Cao , Yao Yao

Scalable generation of outdoor driving scenes requires 3D representations that remain consistent across multiple viewpoints and scale to large areas. Existing solutions either rely on image or video generative models distilled to 3D space,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Hiba Dahmani , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Laurent Caraffa , Jean-Philippe Tarel , Roland Brémond

A complete representation of 3D objects requires characterizing the space of deformations in an interpretable manner, from articulations of a single instance to changes in shape across categories. In this work, we improve on a prior…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tristan Aumentado-Armstrong , Stavros Tsogkas , Sven Dickinson , Allan Jepson

Generative models have emerged as powerful tools in medical imaging, enabling tasks such as segmentation, anomaly detection, and high-quality synthetic data generation. These models typically rely on learning meaningful latent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jordi Malé , Juan Fortea , Mateus Rozalem-Aranha , Neus Martínez-Abadías , Xavier Sevillano

Compact and accurate representations of 3D shapes are central to many perception and robotics tasks. State-of-the-art learning-based methods can reconstruct single objects but scale poorly to large datasets. We present a novel recursive…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Sergey Zakharov , Rares Ambrus , Katherine Liu , Adrien Gaidon

We present a cascaded diffusion model based on a part-level implicit 3D representation. Our model achieves state-of-the-art generation quality and also enables part-level shape editing and manipulation without any additional training in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Juil Koo , Seungwoo Yoo , Minh Hieu Nguyen , Minhyuk Sung