English
Related papers

Related papers: Learning to Generate 3D Shapes with Generative Cel…

200 papers

Neural Cellular Automata (NCA) have shown a remarkable ability to learn the required rules to "grow" images, classify morphologies, segment images, as well as to do general computation such as path-finding. We believe the inductive prior…

Artificial Intelligence · Computer Science 2021-05-18 Alexander Mordvintsev , Eyvind Niklasson , Ettore Randazzo

Cellular automata (CA) are a class of computational models that exhibit rich dynamics emerging from the local interaction of cells arranged in a regular lattice. In this work we focus on a generalised version of typical CA, called graph…

Machine Learning · Computer Science 2021-10-28 Daniele Grattarola , Lorenzo Livi , Cesare Alippi

Methods allowing the synthesis of realistic cell shapes could help generate training data sets to improve cell tracking and segmentation in biomedical images. Deep generative models for cell shape synthesis require a light-weight and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 David Wiesner , Julian Suk , Sven Dummer , David Svoboda , Jelmer M. Wolterink

Significant progress has been made in training large generative models for natural language and images. Yet, the advancement of 3D generative models is hindered by their substantial resource demands for training, along with inefficient,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Ka-Hei Hui , Aditya Sanghi , Arianna Rampini , Kamal Rahimi Malekshan , Zhengzhe Liu , Hooman Shayani , Chi-Wing Fu

We propose a new representation for encoding 3D shapes as neural fields. The representation is designed to be compatible with the transformer architecture and to benefit both shape reconstruction and shape generation. Existing works on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Biao Zhang , Matthias Nießner , Peter Wonka

For humans, visual understanding is inherently generative: given a 3D shape, we can postulate how it would look in the world; given a 2D image, we can infer the 3D structure that likely gave rise to it. We can thus translate between the 2D…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Tristan Aumentado-Armstrong , Alex Levinshtein , Stavros Tsogkas , Konstantinos G. Derpanis , Allan D. Jepson

We propose a novel approach for probabilistic generative modeling of 3D shapes. Unlike most existing models that learn to deterministically translate a latent vector to a shape, our model, Point-Voxel Diffusion (PVD), is a unified,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Linqi Zhou , Yilun Du , Jiajun Wu

The emergence of complex behaviors in cellular automata is an area that has been widely developed in recent years with the intention to generate and analyze automata that produce space-moving patterns or gliders that interact in a periodic…

Generative modeling of anatomical structures plays a crucial role in virtual imaging trials, which allow researchers to perform studies without the costs and constraints inherent to in vivo and phantom studies. For clinical relevance,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Bram de Wilde , Max T. Rietberg , Guillaume Lajoinie , Jelmer M. Wolterink

We introduce a new generative model that combines latent diffusion with persistent homology to create 3D shapes with high diversity, with a special emphasis on their topological characteristics. Our method involves representing 3D shapes as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jiangbei Hu , Ben Fei , Baixin Xu , Fei Hou , Weidong Yang , Shengfa Wang , Na Lei , Chen Qian , Ying He

As several industries are moving towards modeling massive 3D virtual worlds, the need for content creation tools that can scale in terms of the quantity, quality, and diversity of 3D content is becoming evident. In our work, we aim to train…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Jun Gao , Tianchang Shen , Zian Wang , Wenzheng Chen , Kangxue Yin , Daiqing Li , Or Litany , Zan Gojcic , Sanja Fidler

Motivated by the interaction between cells, the recently introduced concept of Neural Cellular Automata shows promising results in a variety of tasks. So far, this concept was mostly used to generate images for a single scenario. As each…

Neural and Evolutionary Computing · Computer Science 2021-08-11 Maximilian Otte , Quentin Delfosse , Johannes Czech , Kristian Kersting

We present a novel alignment-before-generation approach to tackle the challenging task of generating general 3D shapes based on 2D images or texts. Directly learning a conditional generative model from images or texts to 3D shapes is prone…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zibo Zhao , Wen Liu , Xin Chen , Xianfang Zeng , Rui Wang , Pei Cheng , Bin Fu , Tao Chen , Gang Yu , Shenghua Gao

Recently, generative machine-learning models have gained popularity in physics, driven by the goal of improving the efficiency of Markov chain Monte Carlo techniques and of exploring their potential in capturing experimental data…

Statistical Mechanics · Physics 2021-09-03 Japneet Singh , Vipul Arora , Vinay Gupta , Mathias S. Scheurer

Recent advances in machine learning have enabled generative models for both optimization and de novo generation of drug candidates with desired properties. Previous generative models have focused on producing SMILES strings or 2D molecular…

Quantitative Methods · Quantitative Biology 2021-11-25 Michael Arcidiacono , David Ryan Koes

3D generative modeling is accelerating as the technology allowing the capture of geometric data is developing. However, the acquired data is often inconsistent, resulting in unregistered meshes or point clouds. Many generative learning…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Thomas Besnier , Sylvain Arguillère , Emery Pierson , Mohamed Daoudi

Generative models for 3D geometric data arise in many important applications in 3D computer vision and graphics. In this paper, we focus on 3D deformable shapes that share a common topological structure, such as human faces and bodies.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Giorgos Bouritsas , Sergiy Bokhnyak , Stylianos Ploumpis , Michael Bronstein , Stefanos Zafeiriou

While recent generative models for 2D images achieve impressive visual results, they clearly lack the ability to perform 3D reasoning. This heavily restricts the degree of control over generated objects as well as the possible applications…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Dario Pavllo , Graham Spinks , Thomas Hofmann , Marie-Francine Moens , Aurelien Lucchi

Recent advances in deep learning have significantly transformed the field of 3D shape generation, enabling the synthesis of complex, diverse, and semantically meaningful 3D objects. This survey provides a comprehensive overview of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Nicolas Caytuiro , Ivan Sipiran

The success of various applications including robotics, digital content creation, and visualization demand a structured and abstract representation of the 3D world from limited sensor data. Inspired by the nature of human perception of 3D…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chuhang Zou , Ersin Yumer , Jimei Yang , Duygu Ceylan , Derek Hoiem