English
Related papers

Related papers: GFlowNet Pretraining with Inexpensive Rewards

200 papers

Predicting molecular properties with data-driven methods has drawn much attention in recent years. Particularly, Graph Neural Networks (GNNs) have demonstrated remarkable success in various molecular generation and prediction tasks. In…

Quantitative Methods · Quantitative Biology 2021-10-19 Zaixi Zhang , Qi Liu , Hao Wang , Chengqiang Lu , Chee-Kong Lee

In recent years, Graph Neural Network (GNN) based models have shown promising results in simulating physics of complex systems. However, training dedicated graph network based physics simulators can be costly, as most models are confined to…

Machine Learning · Computer Science 2025-02-12 Siqi Shen , Yu Liu , Daniel Biggs , Omar Hafez , Jiandong Yu , Wentao Zhang , Bin Cui , Jiulong Shan

The Generative Flow Network (GFlowNet) is a probabilistic framework in which an agent learns a stochastic policy and flow functions to sample objects proportionally to an unnormalized reward function. A number of recent works explored…

Machine Learning · Computer Science 2025-06-03 Haoran He , Emmanuel Bengio , Qingpeng Cai , Ling Pan

Progress in graph neural networks has grown rapidly in recent years, with many new developments in drug discovery, medical diagnosis, and recommender systems. While this progress is significant, many networks are `black boxes' with little…

Machine Learning · Computer Science 2023-06-09 Eli Laird , Ayesh Madushanka , Elfi Kraka , Corey Clark

Generative artificial intelligence is now a widely used tool in molecular science. Despite the popularity of probabilistic generative models, numerical experiments benchmarking their performance on molecular data are lacking. In this work,…

Machine Learning · Computer Science 2024-11-15 Richard John , Lukas Herron , Pratyush Tiwary

Existing approaches for analyzing neural network activations, such as PCA and sparse autoencoders, rely on strong structural assumptions. Generative models offer an alternative: they can uncover structure without such assumptions and act as…

Machine Learning · Computer Science 2026-02-09 Grace Luo , Jiahai Feng , Trevor Darrell , Alec Radford , Jacob Steinhardt

Property prediction on molecular graphs is an important application of Graph Neural Networks. Recently, unlabeled molecular data has become abundant, which facilitates the rapid development of self-supervised learning for GNNs in the…

Machine Learning · Computer Science 2023-10-31 Kha-Dinh Luong , Ambuj Singh

Graph Neural Networks (GNNs) are deep-learning architectures designed for graph-type data, where understanding relationships among individual observations is crucial. However, achieving promising GNN performance, especially on unseen data,…

Machine Learning · Computer Science 2024-05-22 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Graph neural networks (GNNs), as topology/structure-aware models within deep learning, have emerged as powerful tools for AI-aided drug discovery (AIDD). By directly operating on molecular graphs, GNNs offer an intuitive and expressive…

Biomolecules · Quantitative Biology 2025-06-10 Odin Zhang , Haitao Lin , Xujun Zhang , Xiaorui Wang , Zhenxing Wu , Qing Ye , Weibo Zhao , Jike Wang , Kejun Ying , Yu Kang , Chang-yu Hsieh , Tingjun Hou

Although generative models hold promise for discovering molecules with optimized desired properties, they often fail to suggest synthesizable molecules that improve upon the known molecules seen in training. We find that a key limitation is…

Machine Learning · Computer Science 2025-01-07 Evan R. Antoniuk , Peggy Li , Nathan Keilbart , Stephen Weitzner , Bhavya Kailkhura , Anna M. Hiszpanski

Training-free guidance enables pre-trained diffusion and flow models to optimize application-specific objectives using feedback from external black-box reward functions. However, existing methods are feedback-inefficient because reward…

Machine Learning · Computer Science 2026-05-19 Kim Yong Tan , Yueming Lyu , Ivor Tsang , Yew-Soon Ong

Generative AI poses both opportunities and risks for solving inverse design problems in the sciences. Generative tools provide the ability to expand and refine a search space autonomously, but do so at the cost of exploring low-quality…

Machine Learning · Computer Science 2025-10-01 Marcus Schwarting , Logan Ward , Nathaniel Hudson , Xiaoli Yan , Ben Blaiszik , Santanu Chaudhuri , Eliu Huerta , Ian Foster

Recent progress in Graph Neural Networks (GNNs) for modeling atomic simulations has the potential to revolutionize catalyst discovery, which is a key step in making progress towards the energy breakthroughs needed to combat climate change.…

Machine Learning · Computer Science 2022-04-12 Anuroop Sriram , Abhishek Das , Brandon M. Wood , Siddharth Goyal , C. Lawrence Zitnick

Normalizing Flows are generative models that directly maximize the likelihood. Previously, the design of normalizing flows was largely constrained by the need for analytical invertibility. We overcome this constraint by a training procedure…

Machine Learning · Computer Science 2024-04-25 Felix Draxler , Peter Sorrenson , Lea Zimmermann , Armand Rousselot , Ullrich Köthe

Molecular graph neural networks (GNNs) often focus exclusively on XYZ-based geometric representations and thus overlook valuable chemical context available in public databases like PubChem. This work introduces a multimodal framework that…

Machine Learning · Computer Science 2025-05-20 Can Polat , Hasan Kurban , Erchin Serpedin , Mustafa Kurban

Learning representations of molecular structures using deep learning is a fundamental problem in molecular property prediction tasks. Molecules inherently exist in the real world as three-dimensional structures; furthermore, they are not…

Machine Learning · Computer Science 2024-01-22 Daiki Koge , Naoaki Ono , Shigehiko Kanaya

Molecular graph generation is a fundamental problem for drug discovery and has been attracting growing attention. The problem is challenging since it requires not only generating chemically valid molecular structures but also optimizing…

Machine Learning · Computer Science 2020-02-28 Chence Shi , Minkai Xu , Zhaocheng Zhu , Weinan Zhang , Ming Zhang , Jian Tang

Combination therapy has shown to improve therapeutic efficacy while reducing side effects. Importantly, it has become an indispensable strategy to overcome resistance in antibiotics, anti-microbials, and anti-cancer drugs. Facing enormous…

Molecular Networks · Quantitative Biology 2020-04-24 Mostafa Karimi , Arman Hasanzadeh , Yang shen

We propose a framework using normalizing-flow based models, SELF-Referencing Embedded Strings, and multi-objective optimization that efficiently generates small molecules. With an initial training set of only 100 small molecules, FastFlows…

Chemical Physics · Physics 2022-02-01 Nathan C. Frey , Vijay Gadepally , Bharath Ramsundar

Machine learning is gaining growing momentum in various recent models for the dynamic analysis of information flows in data communications networks. These preliminary models often rely on off-the-shelf learning models to predict from…

Machine Learning · Computer Science 2023-04-04 Xiangle Cheng , James He , Shihan Xiao , Yingxue Zhang , Zhitang Chen , Pascal Poupart , Fenglin Li