English
Related papers

Related papers: Maximum entropy GFlowNets with soft Q-learning

200 papers

Generative Flow Networks or GFlowNets are related to Monte-Carlo Markov chain methods (as they sample from a distribution specified by an energy function), reinforcement learning (as they learn a policy to sample composed objects through a…

Machine Learning · Computer Science 2023-06-21 Ling Pan , Nikolay Malkin , Dinghuai Zhang , Yoshua Bengio

Generative Flow Networks (GFlowNets) are powerful samplers for compositional objects that, by design, sample proportionally to a given non-negative reward. Nonetheless, in practice, they often struggle to explore the reward landscape…

Machine Learning · Computer Science 2026-03-17 Pedro Dall'Antonia , Tiago da Silva , Daniel Augusto de Souza , César Lincoln C. Mattos , Diego Mesquita

This paper studies Generative Flow Networks (GFlowNets), which learn to sample objects proportionally to a given reward function through the trajectory of state transitions. In this work, we observe that GFlowNets tend to under-exploit the…

Machine Learning · Computer Science 2024-10-30 Hyosoon Jang , Yunhui Jang , Minsu Kim , Jinkyoo Park , Sungsoo Ahn

Generative Flow Networks (GFlowNets) treat sampling from distributions over compositional discrete spaces as a sequential decision-making problem, training a stochastic policy to construct objects step by step. Recent studies have revealed…

Machine Learning · Computer Science 2024-06-21 Nikita Morozov , Daniil Tiapkin , Sergey Samsonov , Alexey Naumov , Dmitry Vetrov

Generative Flow Networks (GFlowNets), a new family of probabilistic samplers, have recently emerged as a promising framework for learning stochastic policies that generate high-quality and diverse objects proportionally to their rewards.…

Machine Learning · Computer Science 2024-06-05 Chunhui Li , Cheng-Hao Liu , Dianbo Liu , Qingpeng Cai , Ling Pan

Mathematical reasoning problems are among the most challenging, as they typically require an understanding of fundamental laws to solve. The laws are universal, but the derivation of the final answer changes depending on how a problem is…

Machine Learning · Computer Science 2024-10-29 Ryoichi Takase , Masaya Tsunokake , Yuta Tsuchiya , Shota Inuzuka

Generative flow networks (GFlowNets) are a family of algorithms that learn a generative policy to sample discrete objects $x$ with non-negative reward $R(x)$. Learning objectives guarantee the GFlowNet samples $x$ from the target…

Machine Learning · Computer Science 2023-05-15 Max W. Shen , Emmanuel Bengio , Ehsan Hajiramezanali , Andreas Loukas , Kyunghyun Cho , Tommaso Biancalani

Generative Flow Networks (or GFlowNets for short) are a family of probabilistic agents that learn to sample complex combinatorial structures through the lens of "inference as control". They have shown great potential in generating…

Machine Learning · Computer Science 2023-06-27 Ling Pan , Dinghuai Zhang , Moksh Jain , Longbo Huang , Yoshua Bengio

Unitary Synthesis, the decomposition of a unitary matrix into a sequence of quantum gates, is a fundamental challenge in quantum compilation. Prevailing reinforcement learning (RL) approaches are often hampered by sparse reward signals,…

Quantum Physics · Physics 2026-03-05 Inhoe Koo , Hyunho Cha , Jungwoo Lee

Generative Flow Networks (GFNs) were initially introduced on directed acyclic graphs to sample from an unnormalized distribution density. Recent works have extended the theoretical framework for generative methods allowing more flexibility…

Machine Learning · Computer Science 2025-05-07 Leo Maxime Brunswic , Mateo Clemente , Rui Heng Yang , Adam Sigal , Amir Rasouli , Yinchuan Li

Graph generation is a fundamental task with broad applications, such as drug discovery. Recently, discrete flow matching-based graph generation, \aka, graph flow model (GFM), has emerged due to its superior performance and flexible…

Machine Learning · Computer Science 2026-03-12 Baoheng Zhu , Deyu Bo , Delvin Ce Zhang , Xiao Wang

Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates with probabilities proportional to a given reward. However, GFlowNets can only be used with a predefined scalar reward, which can be…

Machine Learning · Computer Science 2024-02-27 Yihang Chen , Lukas Mauch

Generative flow networks (GFNs) are a class of models for sequential sampling of composite objects, which approximate a target distribution that is defined in terms of an energy function or a reward. GFNs are typically trained using a flow…

Machine Learning · Statistics 2022-10-17 Heiko Zimmermann , Fredrik Lindsten , Jan-Willem van de Meent , Christian A. Naesseth

We introduce BatchGFN -- a novel approach for pool-based active learning that uses generative flow networks to sample sets of data points proportional to a batch reward. With an appropriate reward function to quantify the utility of…

Machine Learning · Computer Science 2023-06-28 Shreshth A. Malik , Salem Lahlou , Andrew Jesson , Moksh Jain , Nikolay Malkin , Tristan Deleu , Yoshua Bengio , Yarin Gal

Generative Flow Networks (GFlowNets) learn to sample states proportional to an unnormalized reward. Despite their theoretical promise, practical training is often unstable, exhibiting severe loss spikes and mode collapse. To tackle this, we…

Generative Flow Networks (GFlowNets) are amortized samplers that learn stochastic policies to sequentially generate compositional objects from a given unnormalized reward distribution. They can generate diverse sets of high-reward objects,…

Machine Learning · Computer Science 2023-10-06 Ling Pan , Moksh Jain , Kanika Madan , Yoshua Bengio

Generative Flow Networks (GFlowNets or GFNs) are probabilistic models predicated on Markov flows, and they employ specific amortization algorithms to learn stochastic policies that generate compositional substances including biomolecules,…

Machine Learning · Computer Science 2025-03-21 Shuai Guo , Jielei Chu , Lin Ma , Zhaoyu Li , Tianrui Li

Generative flow networks (GFlowNets) are a family of algorithms for training a sequential sampler of discrete objects under an unnormalized target density and have been successfully used for various probabilistic modeling tasks. Existing…

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over the years. Existing literature mainly focus on selecting a subgraph, through combinatorial optimization, to provide faithful…

Machine Learning · Computer Science 2023-03-07 Wenqian Li , Yinchuan Li , Zhigang Li , Jianye Hao , Yan Pang

Generative Flow Networks (GFlowNets) are a family of probabilistic generative models that learn to sample compositional objects proportional to their rewards. One big challenge of GFlowNets is training them effectively when dealing with…

Machine Learning · Computer Science 2025-06-16 Zarif Ikram , Ling Pan , Dianbo Liu