English
Related papers

Related papers: Rethinking Molecular Design: Integrating Latent Va…

200 papers

Recently, molecule generation using deep learning has been actively investigated in drug discovery. In this field, Transformer and VAE are widely used as powerful models, but they are rarely used in combination due to structural and…

Biomolecules · Quantitative Biology 2024-04-08 Yasuhiro Yoshikai , Tadahaya Mizuno , Shumpei Nemoto , Hiroyuki Kusuhara

Generative models in molecular design tend to be richly parameterized, data-hungry neural models, as they must create complex structured objects as outputs. Estimating such models from data may be challenging due to the lack of sufficient…

Machine Learning · Computer Science 2021-08-17 Kevin Yang , Wengong Jin , Kyle Swanson , Regina Barzilay , Tommi Jaakkola

Designing new chemical compounds with desired pharmaceutical properties is a challenging task and takes years of development and testing. Still, a majority of new drugs fail to prove efficient. Recent success of deep generative modeling…

Machine Learning · Computer Science 2021-09-15 Karina Zadorozhny , Lada Nuzhna

Geometric representation-conditioned molecule generation provides an effective paradigm that decouples molecule representation modeling from structure generation. By decoupling molecule generation into two stages-first generating a…

Machine Learning · Computer Science 2026-05-11 Shaoheng Yan , Zian Li , Cai Zhou , Qiaojing Huang , Kai Liu , Muhan Zhang

Although machine learning has been successfully used to propose novel molecules that satisfy desired properties, it is still challenging to explore a large chemical space efficiently. In this paper, we present a conditional molecular design…

Machine Learning · Computer Science 2019-04-02 Seokho Kang , Kyunghyun Cho

We introduce the Kernel-Elastic Autoencoder (KAE), a self-supervised generative model based on the transformer architecture with enhanced performance for molecular design. KAE is formulated based on two novel loss functions: modified…

Machine Learning · Computer Science 2024-03-26 Haote Li , Yu Shee , Brandon Allen , Federica Maschietto , Victor Batista

The latent space of generative modeling is long dominated by the VAE encoder. The latents from the pretrained representation encoders (e.g., DINO, SigLIP, MAE) are previously considered inappropriate for generative modeling. Recently, RAE…

Artificial Intelligence · Computer Science 2026-04-03 Hu Yu , Hang Xu , Jie Huang , Zeyue Xue , Haoyang Huang , Nan Duan , Feng Zhao

Many contemporary generative models of molecules are variational auto-encoders of molecular graphs. One term in their training loss pertains to reconstructing the input, yet reconstruction capabilities of state-of-the-art models have not…

Machine Learning · Computer Science 2023-05-05 Hagen Muenkler , Hubert Misztela , Michal Pikusa , Marwin Segler , Nadine Schneider , Krzysztof Maziarz

Materials discovery is decisive for tackling urgent challenges related to energy, the environment, health care and many others. In chemistry, conventional methodologies for innovation usually rely on expensive and incremental strategies to…

Machine Learning · Computer Science 2020-06-09 Daniel Schwalbe-Koda , Rafael Gómez-Bombarelli

In the space of only a few years, deep generative modeling has revolutionized how we think of artificial creativity, yielding autonomous systems which produce original images, music, and text. Inspired by these successes, researchers are…

Machine Learning · Computer Science 2019-05-24 Daniel C. Elton , Zois Boukouvalas , Mark D. Fuge , Peter W. Chung

The discovery of functional molecules is an expensive and time-consuming process, exemplified by the rising costs of small molecule therapeutic discovery. One class of techniques of growing interest for early-stage drug discovery is de novo…

Quantitative Methods · Quantitative Biology 2020-02-18 Wenhao Gao , Connor W. Coley

This paper proposes a latent prompt Transformer model for solving challenging optimization problems such as molecule design, where the goal is to find molecules with optimal values of a target chemical or biological property that can be…

Machine Learning · Computer Science 2024-02-07 Deqian Kong , Yuhao Huang , Jianwen Xie , Ying Nian Wu

Recent advances in neural-based generative modeling have reignited the hopes of having computer systems capable of conversing with humans and able to understand natural language. The employment of deep neural architectures has been largely…

Computation and Language · Computer Science 2022-11-16 Haoqin Tu , Yitong Li

The development of novel pharmaceuticals represents a significant challenge in modern science, with substantial costs and time investments. Deep generative models have emerged as promising tools for accelerating drug discovery by…

Atomic Physics · Physics 2025-05-20 Adarsh Singh

In recent years the scientific community has devoted much effort in the development of deep learning models for the generation of new molecules with desirable properties (i.e. drugs). This has produced many proposals in literature. However,…

Machine Learning · Computer Science 2020-08-24 Davide Rigoni , Nicolò Navarin , Alessandro Sperduti

Objective: This paper investigates how generative models, trained on ground-truth images, can be used \changes{as} priors for inverse problems, penalizing reconstructions far from images the generator can produce. The aim is that learned…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Margaret Duff , Ivor J. A. Simpson , Matthias J. Ehrhardt , Neill D. F. Campbell

Variational autoencdoers (VAE) are a popular approach to generative modelling. However, exploiting the capabilities of VAEs in practice can be difficult. Recent work on regularised and entropic autoencoders have begun to explore the…

Machine Learning · Computer Science 2022-03-02 Gregory A. Daly , Jonathan E. Fieldsend , Gavin Tabor

In this work, we introduce a method to fine-tune a Transformer-based generative model for molecular de novo design. Leveraging the superior sequence learning capacity of Transformers over Recurrent Neural Networks (RNNs), our model can…

Machine Learning · Computer Science 2024-03-11 Pengcheng Xu , Tao Feng , Tianfan Fu , Siddhartha Laghuvarapu , Jimeng Sun

Molecule generation is to design new molecules with specific chemical properties and further to optimize the desired chemical properties. Following previous work, we encode molecules into continuous vectors in the latent space and then…

Machine Learning · Computer Science 2020-01-16 Chaochao Yan , Sheng Wang , Jinyu Yang , Tingyang Xu , Junzhou Huang

Drug discovery aims to find novel compounds with specified chemical property profiles. In terms of generative modeling, the goal is to learn to sample molecules in the intersection of multiple property constraints. This task becomes…

Machine Learning · Computer Science 2020-07-06 Wengong Jin , Regina Barzilay , Tommi Jaakkola