English
Related papers

Related papers: Rethinking Molecular Design: Integrating Latent Va…

200 papers

Is there a unified model for generating molecules considering different conditions, such as binding pockets and chemical properties? Although target-aware generative models have made significant advances in drug design, they do not consider…

Artificial Intelligence · Computer Science 2023-02-15 Zhangyang Gao , Yuqi Hu , Cheng Tan , Stan Z. Li

Transformers generate valid and diverse chemical structures, but little is known about the mechanisms that enable these models to capture the rules of molecular representation. We present a mechanistic analysis of autoregressive…

Machine Learning · Computer Science 2025-12-11 Kristof Varadi , Mark Marosi , Peter Antal

In recent years, deep learning based generative models, particularly Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), and Diffusion Models (DMs), have been instrumental in in generating diverse, high-quality content…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Shamim Yazdani , Akansha Singh , Nripsuta Saxena , Zichong Wang , Avash Palikhe , Deng Pan , Umapada Pal , Jie Yang , Wenbin Zhang

Variational Auto-encoders (VAEs) are deep generative latent variable models consisting of two components: a generative model that captures a data distribution p(x) by transforming a distribution p(z) over latent space, and an inference…

Machine Learning · Computer Science 2022-08-25 Yaniv Yacoby , Weiwei Pan , Finale Doshi-Velez

Generative AI presents chemists with novel ideas for drug design and facilitates the exploration of vast chemical spaces. Diffusion models (DMs), an emerging tool, have recently attracted great attention in drug R\&D. This paper…

Biomolecules · Quantitative Biology 2025-07-14 Peining Zhang , Daniel Baker , Minghu Song , Jinbo Bi

Autoregressive models have demonstrated great performance in natural language processing (NLP) with impressive scalability, adaptability and generalizability. Inspired by their notable success in NLP field, autoregressive models have been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Kai Jiang , Jiaxing Huang

An implicit goal in works on deep generative models is that such models should be able to generate novel examples that were not previously seen in the training data. In this paper, we investigate to what extent this property holds for…

Machine Learning · Computer Science 2018-12-27 Alican Bozkurt , Babak Esmaeili , Dana H. Brooks , Jennifer G. Dy , Jan-Willem van de Meent

Normalizing Flows are generative models that directly maximize the likelihood. Previously, the design of normalizing flows was largely constrained by the need for analytical invertibility. We overcome this constraint by a training procedure…

Machine Learning · Computer Science 2024-04-25 Felix Draxler , Peter Sorrenson , Lea Zimmermann , Armand Rousselot , Ullrich Köthe

We propose a simple yet highly effective method that addresses the mode-collapse problem in the Conditional Generative Adversarial Network (cGAN). Although conditional distributions are multi-modal (i.e., having many modes) in practice,…

Machine Learning · Computer Science 2019-01-28 Dingdong Yang , Seunghoon Hong , Yunseok Jang , Tianchen Zhao , Honglak Lee

Generative models of 3D molecular structure play a rapidly growing role in the design and simulation of molecules. Diffusion models currently dominate the space of 3D molecule generation, while autoregressive models have trailed behind. In…

Machine Learning · Computer Science 2025-09-10 Austin H. Cheng , Chong Sun , Alán Aspuru-Guzik

Deep generative models have been accelerating the inverse design process in material and drug design. Unlike their counterpart property predictors in typical molecular design frameworks, generative molecular design models have seen fewer…

Machine Learning · Computer Science 2024-11-06 A N M Nafiz Abeer , Sanket Jantre , Nathan M Urban , Byung-Jun Yoon

We investigate deep generative models that can exchange multiple modalities bi-directionally, e.g., generating images from corresponding texts and vice versa. A major approach to achieve this objective is to train a model that integrates…

Machine Learning · Statistics 2018-01-29 Masahiro Suzuki , Kotaro Nakayama , Yutaka Matsuo

Probabilistic generative models are attractive for scientific modeling because their inferred parameters can be used to generate hypotheses and design experiments. This requires that the learned model provide an accurate representation of…

Machine Learning · Statistics 2023-01-18 Liyun Tu , Austin Talbot , Neil Gallagher , David Carlson

Recent advances in Deep Learning and probabilistic modeling have led to strong improvements in generative models for images. On the one hand, Generative Adversarial Networks (GANs) have contributed a highly effective adversarial learning…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Yang He , Bernt Schiele , Mario Fritz

Generating a novel and optimized molecule with desired chemical properties is an essential part of the drug discovery process. Failure to meet one of the required properties can frequently lead to failure in a clinical test which is costly.…

Machine Learning · Computer Science 2020-10-28 Bonggun Shin , Sungsoo Park , JinYeong Bak , Joyce C. Ho

Conditional visual generation has witnessed remarkable progress with the advent of diffusion models (DMs), especially in tasks like control-to-image generation. However, challenges such as expensive computational cost, high inference…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Xiang Li , Kai Qiu , Hao Chen , Jason Kuen , Zhe Lin , Rita Singh , Bhiksha Raj

A specific challenge with deep learning approaches for molecule generation is generating both syntactically valid and chemically plausible molecular string representations. To address this, we propose a novel generative latent-variable…

Biomolecules · Quantitative Biology 2024-07-22 Ulrich A. Mbou Sob , Qiulin Li , Miguel Arbesú , Oliver Bent , Andries P. Smit , Arnu Pretorius

In recent years, deep generative models for graphs have been used to generate new molecules. These models have produced good results, leading to several proposals in the literature. However, these models may have troubles learning some of…

Machine Learning · Computer Science 2020-09-03 Davide Rigoni , Nicolò Navarin , Alessandro Sperduti

Generative autoencoders offer a promising approach for controllable text generation by leveraging their latent sentence representations. However, current models struggle to maintain coherent latent spaces required to perform meaningful text…

Machine Learning · Computer Science 2020-07-08 Tianxiao Shen , Jonas Mueller , Regina Barzilay , Tommi Jaakkola

In many domains generating variable length sequences through insertions provides greater flexibility over autoregressive models. However, the action space of insertion models is much larger than that of autoregressive models (ARMs) making…