English
Related papers

Related papers: GFlowNet Training by Policy Gradients

200 papers

The Generative Flow Network (GFlowNet) is a probabilistic framework in which an agent learns a stochastic policy and flow functions to sample objects proportionally to an unnormalized reward function. A number of recent works explored…

Machine Learning · Computer Science 2025-06-03 Haoran He , Emmanuel Bengio , Qingpeng Cai , Ling Pan

We present GFlowState, a visual analytics system designed to illuminate the training process of Generative Flow Networks (GFlowNets or GFNs). GFlowNets are a probabilistic framework for generating samples proportionally to a reward…

Machine Learning · Computer Science 2026-04-24 Florian Holeczek , Andreas Hinterreiter , Alex Hernandez-Garcia , Marc Streit , Christina Humer

Mathematical reasoning problems are among the most challenging, as they typically require an understanding of fundamental laws to solve. The laws are universal, but the derivation of the final answer changes depending on how a problem is…

Machine Learning · Computer Science 2024-10-29 Ryoichi Takase , Masaya Tsunokake , Yuta Tsuchiya , Shota Inuzuka

Generative Flow Networks (GFlowNets, GFNs) are a generative framework for learning unnormalized probability mass functions over discrete spaces. Since their inception, GFlowNets have proven to be useful for learning generative models in…

Machine Learning · Computer Science 2025-04-17 Lazar Atanackovic , Emmanuel Bengio

Generative flow networks (GFlowNets) are a family of algorithms for training a sequential sampler of discrete objects under an unnormalized target density and have been successfully used for various probabilistic modeling tasks. Existing…

Many score-based active learning methods have been successfully applied to graph-structured data, aiming to reduce the number of labels and achieve better performance of graph neural networks based on predefined score functions. However,…

Machine Learning · Computer Science 2023-04-25 Yinchuan Li , Zhigang Li , Wenqian Li , Yunfeng Shao , Yan Zheng , Jianye Hao

Likelihood-based policy gradient methods are the dominant approach for training robot control policies from rewards. These methods rely on differentiable action likelihoods, which constrain policy outputs to simple distributions like…

Generative Flow Networks (GFlowNets) are powerful samplers for compositional objects that, by design, sample proportionally to a given non-negative reward. Nonetheless, in practice, they often struggle to explore the reward landscape…

Machine Learning · Computer Science 2026-03-17 Pedro Dall'Antonia , Tiago da Silva , Daniel Augusto de Souza , César Lincoln C. Mattos , Diego Mesquita

Generative flow networks utilize a flow-matching loss to learn a stochastic policy for generating objects from a sequence of actions, such that the probability of generating a pattern can be proportional to the corresponding given reward.…

Machine Learning · Computer Science 2025-09-26 Leo Maxime Brunswic , Haozhi Wang , Shuang Luo , Jianye Hao , Amir Rasouli , Yinchuan Li

Generative Flow Networks (GFlowNets) are a family of probabilistic generative models that learn to sample compositional objects proportional to their rewards. One big challenge of GFlowNets is training them effectively when dealing with…

Machine Learning · Computer Science 2025-06-16 Zarif Ikram , Ling Pan , Dianbo Liu

We present \textbf{FlowRL}, a novel framework for online reinforcement learning that integrates flow-based policy representation with Wasserstein-2-regularized optimization. We argue that in addition to training signals, enhancing the…

Machine Learning · Computer Science 2025-06-17 Lei Lv , Yunfei Li , Yu Luo , Fuchun Sun , Tao Kong , Jiafeng Xu , Xiao Ma

Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates in an active learning context, with a training objective that makes them approximately sample in proportion to a given reward…

Machine Learning · Computer Science 2026-01-27 Yoshua Bengio , Salem Lahlou , Tristan Deleu , Edward J. Hu , Mo Tiwari , Emmanuel Bengio

Generative Flow Networks (GFlowNets) are a class of generative models that sample objects in proportion to a specified reward function through a learned policy. They can be trained either on-policy or off-policy, needing a balance between…

Machine Learning · Computer Science 2025-03-04 Dominic Phillips , Flaviu Cipcigan

Generative Flow Networks (GFlowNets) learn to sample states proportional to an unnormalized reward. Despite their theoretical promise, practical training is often unstable, exhibiting severe loss spikes and mode collapse. To tackle this, we…

Generative Flow Networks (GFlowNets), a new family of probabilistic samplers, have recently emerged as a promising framework for learning stochastic policies that generate high-quality and diverse objects proportionally to their rewards.…

Machine Learning · Computer Science 2024-06-05 Chunhui Li , Cheng-Hao Liu , Dianbo Liu , Qingpeng Cai , Ling Pan

Generative Flow Networks (GFlowNets) are amortized inference models designed to sample from unnormalized distributions over composable objects, with applications in generative modeling for tasks in fields such as causal discovery, NLP, and…

Machine Learning · Computer Science 2026-04-13 Tiago da Silva , Eliezer de Souza da Silva , Diego Mesquita

In this work, we consider the radio resource allocation problem in a wireless system with various integrated functionalities, such as communication, sensing and computing. We design suitable resource management techniques that can…

Machine Learning · Computer Science 2025-05-09 Charbel Bou Chaaya , Mehdi Bennis

Reinforcement Learning (RL) algorithms aim to learn an optimal policy by iteratively sampling actions to learn how to maximize the total expected return, $R(x)$. GFlowNets are a special class of algorithms designed to generate diverse…

Machine Learning · Computer Science 2023-07-19 Nikhil Vemgal , Elaine Lau , Doina Precup

Recent advances have shown that video generation models can enhance robot learning by deriving effective robot actions through inverse dynamics. However, these methods heavily depend on the quality of generated data and struggle with…

Robotics · Computer Science 2025-08-18 Kelin Yu , Sheng Zhang , Harshit Soora , Furong Huang , Heng Huang , Pratap Tokekar , Ruohan Gao

Generative Flow Networks (GFlowNets) are recently proposed models for learning stochastic policies that generate compositional objects by sequences of actions with the probability proportional to a given reward function. The central problem…

Machine Learning · Computer Science 2022-10-03 Anh Do , Duy Dinh , Tan Nguyen , Khuong Nguyen , Stanley Osher , Nhat Ho