English
Related papers

Related papers: Structural bias in three-dimensional autoregressiv…

200 papers

Diffusion generative models have emerged as a powerful framework for addressing problems in structural biology and structure-based drug design. These models operate directly on 3D molecular structures. Due to the unfavorable scaling of…

Biomolecules · Quantitative Biology 2024-05-10 Ian Dunn , David Ryan Koes

We study how to generate molecule conformations (i.e., 3D structures) from a molecular graph. Traditional methods, such as molecular dynamics, sample conformations via computationally expensive simulations. Recently, machine learning…

Machine Learning · Computer Science 2021-04-01 Minkai Xu , Shitong Luo , Yoshua Bengio , Jian Peng , Jian Tang

Molecular generative models often assume meaningful latent geometry, but apparent property predictability can reflect sequence-level shortcuts rather than chemical organization. We study this issue in an unsupervised autoregressive…

Machine Learning · Computer Science 2026-05-08 Zakaria Elabid , Jan Andrzejewski , Bartosz Brzoza , Attila Cangi

Generative flow networks (GFlowNets) are a family of algorithms that learn a generative policy to sample discrete objects $x$ with non-negative reward $R(x)$. Learning objectives guarantee the GFlowNet samples $x$ from the target…

Machine Learning · Computer Science 2023-05-15 Max W. Shen , Emmanuel Bengio , Ehsan Hajiramezanali , Andreas Loukas , Kyunghyun Cho , Tommaso Biancalani

In Bayesian structure learning, we are interested in inferring a distribution over the directed acyclic graph (DAG) structure of Bayesian networks, from data. Defining such a distribution is very challenging, due to the combinatorially…

Machine Learning · Computer Science 2022-06-30 Tristan Deleu , António Góis , Chris Emezue , Mansi Rankawat , Simon Lacoste-Julien , Stefan Bauer , Yoshua Bengio

Despite recent advances, goal-directed generation of structured discrete data remains challenging. For problems such as program synthesis (generating source code) and materials design (generating molecules), finding examples which satisfy…

Machine Learning · Computer Science 2020-10-26 Amina Mollaysa , Brooks Paige , Alexandros Kalousis

The incredible capabilities of generative artificial intelligence models have inevitably led to their application in the domain of drug discovery. Within this domain, the vastness of chemical space motivates the development of more…

Machine Learning · Computer Science 2024-02-08 Gregory W. Kyro , Anton Morgunov , Rafael I. Brent , Victor S. Batista

Building predictive models for tabular data presents fundamental challenges, notably in scaling consistently, i.e., more resources translating to better performance, and generalizing systematically beyond the training data distribution.…

Humans excel at discovering regular structures from limited samples and applying inferred rules to novel settings. We investigate whether modern generative models can similarly learn underlying rules from finite samples and perform…

Machine Learning · Computer Science 2024-11-13 Binxu Wang , Jiaqi Shang , Haim Sompolinsky

Deep generative models have recently been applied to molecule design. If the molecules are encoded in linear SMILES strings, modeling becomes convenient. However, models relying on string representations tend to generate invalid samples and…

Machine Learning · Computer Science 2020-10-20 Bo Pang , Tian Han , Ying Nian Wu

Generative Flow Networks (GFlowNets) learn to sample diverse candidates in proportion to a reward function, making them well-suited for scientific discovery, where exploring multiple promising solutions is crucial. Further extending…

Machine Learning · Computer Science 2026-05-29 Seokwon Yoon , Youngbin Choi , Seunghyuk Cho , Seungbeom Lee , MoonJeong Park , Dongwoo Kim

Generative artificial intelligence models learn probability distributions from data and produce novel samples that capture the salient properties of their training sets. Proteins are particularly attractive for such approaches given their…

Biomolecules · Quantitative Biology 2026-02-27 Filippo Stocco , Michele Garibbo , Noelia Ferruz

Generative methods (Gen-AI) are reviewed with a particular goal of solving tasks in machine learning and Bayesian inference. Generative models require one to simulate a large training dataset and to use deep neural networks to solve a…

Computation · Statistics 2025-05-20 Maria Nareklishvili , Nick Polson , Vadim Sokolov

Molecular structure generation is a fundamental problem that involves determining the 3D positions of molecules' constituents. It has crucial biological applications, such as molecular docking, protein folding, and molecular design. Recent…

Machine Learning · Computer Science 2025-08-27 Wenyin Zhou , Christopher Iliffe Sprague , Vsevolod Viliuga , Matteo Tadiello , Arne Elofsson , Hossein Azizpour

Given large amount of real photos for training, Convolutional neural network shows excellent performance on object recognition tasks. However, the process of collecting data is so tedious and the background are also limited which makes it…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Yida Wang , Weihong Deng

Deep generative models have emerged as an exciting avenue for inverse molecular design, with progress coming from the interplay between training algorithms and molecular representations. One of the key challenges in their applicability to…

Shape-based virtual screening is widely employed in ligand-based drug design to search chemical libraries for molecules with similar 3D shapes yet novel 2D chemical structures compared to known ligands. 3D deep generative models have the…

Chemical Physics · Physics 2022-10-12 Keir Adams , Connor W. Coley

We report a series of deep learning models to solve complex forward and inverse design problems in molecular modeling and design. Using both diffusion models inspired by nonequilibrium thermodynamics and attention-based transformer…

Materials Science · Physics 2023-06-21 Rachel K. Luu , Marcin Wysokowski , Markus J. Buehler

In this work, we introduce a method to fine-tune a Transformer-based generative model for molecular de novo design. Leveraging the superior sequence learning capacity of Transformers over Recurrent Neural Networks (RNNs), our model can…

Machine Learning · Computer Science 2024-03-11 Pengcheng Xu , Tao Feng , Tianfan Fu , Siddhartha Laghuvarapu , Jimeng Sun

A major challenge in computational chemistry is the generation of novel molecular structures with desirable pharmacological and physiochemical properties. In this work, we investigate the potential use of autoencoder, a deep learning…

Machine Learning · Computer Science 2017-11-22 Thomas Blaschke , Marcus Olivecrona , Ola Engkvist , Jürgen Bajorath , Hongming Chen