English
Related papers

Related papers: Compress3D: a Compressed Latent Space for 3D Gener…

200 papers

Deep generative architectures provide a way to model not only images but also complex, 3-dimensional objects, such as point clouds. In this work, we present a novel method to obtain meaningful representations of 3D shapes that can be used…

Machine Learning · Computer Science 2019-05-03 Maciej Zamorski , Maciej Zięba , Piotr Klukowski , Rafał Nowak , Karol Kurach , Wojciech Stokowiec , Tomasz Trzciński

We present a novel approach to the generation of static and articulated 3D assets that has a 3D autodecoder at its core. The 3D autodecoder framework embeds properties learned from the target dataset in the latent space, which can then be…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Evangelos Ntavelis , Aliaksandr Siarohin , Kyle Olszewski , Chaoyang Wang , Luc Van Gool , Sergey Tulyakov

We propose an auto-encoder architecture for multi-texture synthesis. The approach relies on both a compact encoder accounting for second order neural statistics and a generator incorporating adaptive periodic content. Images are embedded in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Pierrick Chatillon , Yann Gousseau , Sidonie Lefebvre

This article proposes a data-driven methodology to achieve a fast design support, in order to generate or develop novel designs covering multiple object categories. This methodology implements two state-of-the-art Variational Autoencoder…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Zhangsihao Yang , Haoliang Jiang , Zou Lan

In recent years, 3D generation has made great strides in both academia and industry. However, generating 3D scenes from a single RGB image remains a significant challenge, as current approaches often struggle to ensure both object…

Graphics · Computer Science 2026-02-18 Xiang Tang , Ruotong Li , Xiaopeng Fan

In this paper, we propose Extend3D, a training-free pipeline for 3D scene generation from a single image, built upon an object-centric 3D generative model. To overcome the limitations of fixed-size latent spaces in object-centric models for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Seungwoo Yoon , Jinmo Kim , Jaesik Park

We propose a data-driven 3D shape design method that can learn a generative model from a corpus of existing designs, and use this model to produce a wide range of new designs. The approach learns an encoding of the samples in the training…

Generating high-quality videos that synthesize desired realistic content is a challenging task due to their intricate high-dimensionality and complexity of videos. Several recent diffusion-based methods have shown comparable performance by…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Kihong Kim , Haneol Lee , Jihye Park , Seyeon Kim , Kwanghee Lee , Seungryong Kim , Jaejun Yoo

We propose L3DG, the first approach for generative 3D modeling of 3D Gaussians through a latent 3D Gaussian diffusion formulation. This enables effective generative 3D modeling, scaling to generation of entire room-scale scenes which can be…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Barbara Roessle , Norman Müller , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Angela Dai , Matthias Nießner

We introduce AutoPartGen, a model that generates objects composed of 3D parts in an autoregressive manner. This model can take as input an image of an object, 2D masks of the object's parts, or an existing 3D object, and generate a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Minghao Chen , Jianyuan Wang , Roman Shapovalov , Tom Monnier , Hyunyoung Jung , Dilin Wang , Rakesh Ranjan , Iro Laina , Andrea Vedaldi

We present a novel algorithm to reduce tensor compute required by a conditional image generation autoencoder without sacrificing quality of photo-realistic image generation. Our method is device agnostic, and can optimize an autoencoder for…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Nisarg A. Shah , Gaurav Bharaj

This report presents a comprehensive framework for generating high-quality 3D shapes and textures from diverse input prompts, including single images, multi-view images, and text descriptions. The framework consists of 3D shape generation…

Existing diffusion-based 3D scene generation methods primarily operate in 2D image/video latent spaces, which makes maintaining cross-view appearance and geometric consistency inherently challenging. To bridge this gap, we present OneWorld,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Sensen Gao , Zhaoqing Wang , Qihang Cao , Dongdong Yu , Changhu Wang , Tongliang Liu , Mingming Gong , Jiawang Bian

The computational cost of traditional Computational Fluid Dynamics-based Aerodynamic Shape Optimization severely restricts design space exploration. This paper introduces TripOptimizer, a fully differentiable deep learning framework for…

Machine Learning · Computer Science 2025-12-04 Parsa Vatani , Mohamed Elrefaie , Farhad Nazarpour , Faez Ahmed

Recent advances in sparse voxel representations have significantly improved the quality of 3D content generation, enabling high-resolution modeling with fine-grained geometry. However, existing frameworks suffer from severe computational…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yiwen Chen , Zhihao Li , Yikai Wang , Hu Zhang , Qin Li , Chi Zhang , Guosheng Lin

We present SparseGen, a novel framework for efficient image-to-3D generation, which exhibits low input-view bias while being significantly faster. Unlike traditional approaches that rely on dense volumetric grids, triplanes, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Zhiyuan Xu , Jiuming Liu , Yuxin Chen , Masayoshi Tomizuka , Chenfeng Xu , Chensheng Peng

Previous approaches to generate shapes in a 3D setting train a GAN on the latent space of an autoencoder (AE). Even though this produces convincing results, it has two major shortcomings. As the GAN is limited to reproduce the dataset the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Moritz Ibing , Isaak Lim , Leif Kobbelt

We present a latent diffusion model for fast feed-forward 3D scene generation. Given one or more images, our model Bolt3D directly samples a 3D scene representation in less than seven seconds on a single GPU. We achieve this by leveraging…

We present a cascaded diffusion model based on a part-level implicit 3D representation. Our model achieves state-of-the-art generation quality and also enables part-level shape editing and manipulation without any additional training in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Juil Koo , Seungwoo Yoo , Minh Hieu Nguyen , Minhyuk Sung

Recent advances in 3D generation have transitioned from multi-view 2D rendering approaches to 3D-native latent diffusion frameworks that exploit geometric priors in ground truth data. Despite progress, three key limitations persist: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shaocong Dong , Lihe Ding , Xiao Chen , Yaokun Li , Yuxin Wang , Yucheng Wang , Qi Wang , Jaehyeok Kim , Chenjian Gao , Zhanpeng Huang , Zibin Wang , Tianfan Xue , Dan Xu