English
Related papers

Related papers: Thompson sampling for improved exploration in GFlo…

200 papers

The challenge of discovering new molecules with desired properties is crucial in domains like drug discovery and material design. Recent advances in deep learning-based generative methods have shown promise but face the issue of sample…

Biomolecules · Quantitative Biology 2024-12-31 Hyeonah Kim , Minsu Kim , Sanghyeok Choi , Jinkyoo Park

Generative Flow Networks (GFlowNets) are amortized samplers that learn stochastic policies to sequentially generate compositional objects from a given unnormalized reward distribution. They can generate diverse sets of high-reward objects,…

Machine Learning · Computer Science 2023-10-06 Ling Pan , Moksh Jain , Kanika Madan , Yoshua Bengio

This paper is about the problem of learning a stochastic policy for generating an object (like a molecular graph) from a sequence of actions, such that the probability of generating an object is proportional to a given positive reward for…

Machine Learning · Computer Science 2021-11-22 Emmanuel Bengio , Moksh Jain , Maksym Korablyov , Doina Precup , Yoshua Bengio

Generative Flow Networks (GFlowNets) learn to sample diverse candidates in proportion to a reward function, making them well-suited for scientific discovery, where exploring multiple promising solutions is crucial. Further extending…

Machine Learning · Computer Science 2026-05-29 Seokwon Yoon , Youngbin Choi , Seunghyuk Cho , Seungbeom Lee , MoonJeong Park , Dongwoo Kim

Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates in an active learning context, with a training objective that makes them approximately sample in proportion to a given reward…

Machine Learning · Computer Science 2026-01-27 Yoshua Bengio , Salem Lahlou , Tristan Deleu , Edward J. Hu , Mo Tiwari , Emmanuel Bengio

Phylogenetics is a branch of computational biology that studies the evolutionary relationships among biological entities. Its long history and numerous applications notwithstanding, inference of phylogenetic trees from sequence data remains…

Populations and Evolution · Quantitative Biology 2024-03-26 Mingyang Zhou , Zichao Yan , Elliot Layne , Nikolay Malkin , Dinghuai Zhang , Moksh Jain , Mathieu Blanchette , Yoshua Bengio

Generative flow networks utilize a flow-matching loss to learn a stochastic policy for generating objects from a sequence of actions, such that the probability of generating a pattern can be proportional to the corresponding given reward.…

Machine Learning · Computer Science 2025-09-26 Leo Maxime Brunswic , Haozhi Wang , Shuang Luo , Jianye Hao , Amir Rasouli , Yinchuan Li

GFlowNets is a novel flow-based method for learning a stochastic policy to generate objects via a sequence of actions and with probability proportional to a given positive reward. We contribute to relaxing hypotheses limiting the…

Machine Learning · Computer Science 2024-05-14 Leo Maxime Brunswic , Yinchuan Li , Yushun Xu , Shangling Jui , Lizhuang Ma

Generative Flow Networks (GFlowNets; GFNs) are a family of energy-based generative methods for combinatorial objects, capable of generating diverse and high-utility samples. However, consistently biasing GFNs towards producing high-utility…

Machine Learning · Computer Science 2024-11-04 Elaine Lau , Stephen Zhewen Lu , Ling Pan , Doina Precup , Emmanuel Bengio

Generative Flow Networks (GFlowNets) were developed to learn policies for efficiently sampling combinatorial candidates by interpreting their generative processes as trajectories in directed acyclic graphs. In the value-based training…

Machine Learning · Computer Science 2026-03-03 Puhua Niu , Shili Wu , Xiaoning Qian

Generative Flow Networks (GFlowNets or GFNs) are probabilistic models predicated on Markov flows, and they employ specific amortization algorithms to learn stochastic policies that generate compositional substances including biomolecules,…

Machine Learning · Computer Science 2025-03-21 Shuai Guo , Jielei Chu , Lin Ma , Zhaoyu Li , Tianrui Li

We study the use of policy gradient algorithms to optimize over a class of generalized Thompson sampling policies. Our central insight is to view the posterior parameter sampled by Thompson sampling as a kind of pseudo-action. Policy…

Machine Learning · Computer Science 2020-07-01 Seungki Min , Ciamac C. Moallemi , Daniel J. Russo

Deep learning is emerging as an effective tool in drug discovery, with potential applications in both predictive and generative models. Generative Flow Networks (GFlowNets/GFNs) are a recently introduced method recognized for the ability to…

Machine Learning · Computer Science 2023-11-08 Elaine Lau , Nikhil Vemgal , Doina Precup , Emmanuel Bengio

Generative Flow Networks (GFlowNets) have been shown effective to generate combinatorial objects with desired properties. We here propose a new GFlowNet training framework, with policy-dependent rewards, that bridges keeping flow balance of…

Machine Learning · Computer Science 2025-06-04 Puhua Niu , Shili Wu , Mingzhou Fan , Xiaoning Qian

Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates with probabilities proportional to a given reward. However, GFlowNets can only be used with a predefined scalar reward, which can be…

Machine Learning · Computer Science 2024-02-27 Yihang Chen , Lukas Mauch

Generative Flow Networks (GFlowNets) treat sampling from distributions over compositional discrete spaces as a sequential decision-making problem, training a stochastic policy to construct objects step by step. Recent studies have revealed…

Machine Learning · Computer Science 2024-06-21 Nikita Morozov , Daniil Tiapkin , Sergey Samsonov , Alexey Naumov , Dmitry Vetrov

Generative Flow Networks (GFlowNets) offer a powerful framework for sampling graphs in proportion to their rewards. However, existing approaches suffer from systematic biases due to inaccuracies in state transition probability computations.…

Machine Learning · Statistics 2025-10-17 Hohyun Kim , Seunggeun Lee , Min-hwan Oh

Generative Flow Networks (GFlowNets) learn to sample states proportional to an unnormalized reward. Despite their theoretical promise, practical training is often unstable, exhibiting severe loss spikes and mode collapse. To tackle this, we…

The Generative Flow Network is a probabilistic framework where an agent learns a stochastic policy for object generation, such that the probability of generating an object is proportional to a given reward function. Its effectiveness has…

Machine Learning · Computer Science 2022-10-10 Ling Pan , Dinghuai Zhang , Aaron Courville , Longbo Huang , Yoshua Bengio

Generative Flow Networks (GFlowNets, GFNs) are a generative framework for learning unnormalized probability mass functions over discrete spaces. Since their inception, GFlowNets have proven to be useful for learning generative models in…

Machine Learning · Computer Science 2025-04-17 Lazar Atanackovic , Emmanuel Bengio