English
Related papers

Related papers: Deep Generative Models on 3D Representations: A Su…

200 papers

In the last few years, there have been several revolutions in the field of deep learning, mainly headlined by the large impact of Generative Adversarial Networks (GANs). GANs not only provide an unique architecture when defining their…

Machine Learning · Computer Science 2024-02-19 Guillermo Iglesias , Edgar Talavera , Alberto Díaz-Álvarez

The remarkable progress in neural-network-driven visual data generation, especially with neural rendering techniques like Neural Radiance Fields and 3D Gaussian splatting, offers a powerful alternative to GANs and diffusion models. These…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Chengdong Dong , Vijayakumar Bhagavatula , Zhenyu Zhou , Ajay Kumar

Generative concept representations have three major advantages over discriminative ones: they can represent uncertainty, they support integration of learning and reasoning, and they are good for unsupervised and semi-supervised learning. We…

Machine Learning · Computer Science 2018-11-19 Daniel T. Chang

Unsupervised generation of high-quality multi-view-consistent images and 3D shapes using only collections of single-view 2D photographs has been a long-standing challenge. Existing 3D GANs are either compute-intensive or make approximations…

Recent work has shown the ability to learn generative models for 3D shapes from only unstructured 2D images. However, training such models requires differentiating through the rasterization step of the rendering process, therefore past work…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Sebastian Lunz , Yingzhen Li , Andrew Fitzgibbon , Nate Kushman

This paper considers neural representation through the lens of active inference, a normative framework for understanding brain function. It delves into how living organisms employ generative models to minimize the discrepancy between…

Neurons and Cognition · Quantitative Biology 2023-10-24 Giovanni Pezzulo , Leo D'Amato , Francesco Mannella , Matteo Priorelli , Toon Van de Maele , Ivilin Peev Stoianov , Karl Friston

World modeling has become a cornerstone in AI research, enabling agents to understand, represent, and predict the dynamic environments they inhabit. While prior work largely emphasizes generative methods for 2D image and video data, they…

Understanding and predicting the progression of neurodegenerative diseases remains a major challenge in medical AI, with significant implications for early diagnosis, disease monitoring, and treatment planning. However, most available…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Nivetha Jayakumar , Swakshar Deb , Bahram Jafrasteh , Qingyu Zhao , Miaomiao Zhang

Generative adversarial networks (GANs) provide an algorithmic framework for constructing generative models with several appealing properties: they do not require a likelihood function to be specified, only a generating procedure; they…

Machine Learning · Statistics 2017-02-28 Shakir Mohamed , Balaji Lakshminarayanan

Deep generative models have garnered significant attention in low-level vision tasks due to their generative capabilities. Among them, diffusion model-based solutions, characterized by a forward diffusion process and a reverse denoising…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Chunming He , Yuqi Shen , Chengyu Fang , Fengyang Xiao , Longxiang Tang , Yulun Zhang , Wangmeng Zuo , Zhenhua Guo , Xiu Li

Generative models are typically trained on grid-like data such as images. As a result, the size of these models usually scales directly with the underlying grid resolution. In this paper, we abandon discretized grids and instead…

Machine Learning · Computer Science 2022-02-18 Emilien Dupont , Yee Whye Teh , Arnaud Doucet

Deep generative architectures provide a way to model not only images but also complex, 3-dimensional objects, such as point clouds. In this work, we present a novel method to obtain meaningful representations of 3D shapes that can be used…

Machine Learning · Computer Science 2019-05-03 Maciej Zamorski , Maciej Zięba , Piotr Klukowski , Rafał Nowak , Karol Kurach , Wojciech Stokowiec , Tomasz Trzciński

Deep learning has recently been applied to various research areas of design optimization. This study presents the need and effectiveness of adopting deep learning for generative design (or design exploration) research area. This work…

Machine Learning · Computer Science 2020-05-27 Sangeun Oh , Yongsu Jung , Seongsin Kim , Ikjin Lee , Namwoo Kang

Over the past years, image generation and manipulation have achieved remarkable progress due to the rapid development of generative AI based on deep learning. Recent studies have devoted significant efforts to address the problem of face…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Yuhang Lu , Touradj Ebrahimi

The creation of manufacturable and editable 3D shapes through Computer-Aided Design (CAD) remains a highly manual and time-consuming task, hampered by the complex topology of boundary representations of 3D solids and unintuitive design…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Md Ferdous Alam , Faez Ahmed

The success of various applications including robotics, digital content creation, and visualization demand a structured and abstract representation of the 3D world from limited sensor data. Inspired by the nature of human perception of 3D…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chuhang Zou , Ersin Yumer , Jimei Yang , Duygu Ceylan , Derek Hoiem

When working with three-dimensional data, choice of representation is key. We explore voxel-based models, and present evidence for the viability of voxellated representations in applications including shape modeling and object…

Computer Vision and Pattern Recognition · Computer Science 2016-08-17 Andrew Brock , Theodore Lim , J. M. Ritchie , Nick Weston

We present a survey on 4D generation and reconstruction, a fast-evolving subfield of computer graphics whose developments have been propelled by recent advances in neural fields, geometric and motion deep learning, as well as 3D generative…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Mingrui Zhao , Sauradip Nag , Kai Wang , Aditya Vora , Guangda Ji , Peter Chun , Ali Mahdavi-Amiri , Hao Zhang

Generative networks have shown remarkable success in learning complex data distributions, particularly in generating high-dimensional data from lower-dimensional inputs. While this capability is well-documented empirically, its theoretical…

Machine Learning · Computer Science 2025-04-02 Kevin Wang , Hongqian Niu , Yixin Wang , Didong Li

Recent advances in deep learning led to novel generative modeling techniques that achieve unprecedented quality in generated samples and performance in learning complex distributions in imaging data. These new models in medical image…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Xiaoran Chen , Nick Pawlowski , Martin Rajchl , Ben Glocker , Ender Konukoglu