English
Related papers

Related papers: GFlowNet Training by Policy Gradients

200 papers

Generative Flow Networks (GFlowNets) excel at sampling diverse, high-reward objects. In many practical applications where active reward queries are infeasible, these models must be trained using static offline datasets. Prevailing training…

Machine Learning · Computer Science 2026-05-26 Ruishuo Chen , Xun Wang , Rui Hu , Zhuoran Li , Longbo Huang

Generative flow networks (GFlowNets) are amortized variational inference algorithms that treat sampling from a distribution over compositional objects as a sequential decision-making problem with a learnable action policy. Unlike other…

Generative models, particularly diffusion models, have achieved remarkable success in density estimation for multimodal data, drawing significant interest from the reinforcement learning (RL) community, especially in policy modeling in…

Machine Learning · Computer Science 2024-12-03 Jinouwen Zhang , Rongkun Xue , Yazhe Niu , Yun Chen , Jing Yang , Hongsheng Li , Yu Liu

Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates with probabilities proportional to a given reward. However, GFlowNets can only be used with a predefined scalar reward, which can be…

Machine Learning · Computer Science 2024-02-27 Yihang Chen , Lukas Mauch

Generative Flow Networks (GFlowNets or GFNs) are probabilistic models predicated on Markov flows, and they employ specific amortization algorithms to learn stochastic policies that generate compositional substances including biomolecules,…

Machine Learning · Computer Science 2025-03-21 Shuai Guo , Jielei Chu , Lin Ma , Zhaoyu Li , Tianrui Li

Generative Flow Networks (or GFlowNets for short) are a family of probabilistic agents that learn to sample complex combinatorial structures through the lens of "inference as control". They have shown great potential in generating…

Machine Learning · Computer Science 2023-06-27 Ling Pan , Dinghuai Zhang , Moksh Jain , Longbo Huang , Yoshua Bengio

Unitary Synthesis, the decomposition of a unitary matrix into a sequence of quantum gates, is a fundamental challenge in quantum compilation. Prevailing reinforcement learning (RL) approaches are often hampered by sparse reward signals,…

Quantum Physics · Physics 2026-03-05 Inhoe Koo , Hyunho Cha , Jungwoo Lee

Traditional reinforcement learning often struggles to generate diverse, high-reward solutions, especially in domains like drug design and black-box function optimization. Markov Chain Monte Carlo (MCMC) methods provide an alternative method…

Machine Learning · Computer Science 2024-10-02 Siyi He

Generative Flow Networks (GFlowNets) have demonstrated significant performance improvements for generating diverse discrete objects $x$ given a reward function $R(x)$, indicating the utility of the object and trained independently from the…

Machine Learning · Computer Science 2022-11-03 Chanakya Ekbote , Moksh Jain , Payel Das , Yoshua Bengio

Generative Flow Networks (GFlowNets), a class of generative models have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from unnormalized reward distributions. Previous works…

Machine Learning · Computer Science 2024-09-17 Mohit Pandey , Gopeshh Subbaraj , Emmanuel Bengio

Generative Flow Networks (GFlowNets) are a novel class of generative models designed to sample from unnormalized distributions and have found applications in various important tasks, attracting great research interest in their training…

Machine Learning · Computer Science 2024-10-04 Rui Hu , Yifan Zhang , Zhuoran Li , Longbo Huang

GFlowNets is a novel flow-based method for learning a stochastic policy to generate objects via a sequence of actions and with probability proportional to a given positive reward. We contribute to relaxing hypotheses limiting the…

Machine Learning · Computer Science 2024-05-14 Leo Maxime Brunswic , Yinchuan Li , Yushun Xu , Shangling Jui , Lizhuang Ma

Generative recommendations (GR), which usually include item tokenizers and generative Large Language Models (LLMs), have demonstrated remarkable success across a wide range of scenarios. The majority of existing research efforts primarily…

Information Retrieval · Computer Science 2025-11-25 Yejing Wang , Shengyu Zhou , Jinyu Lu , Qidong Liu , Xinhang Li , Wenlin Zhang , Feng Li , Pengjie Wang , Jian Xu , Bo Zheng , Xiangyu Zhao

GFlowNets are probabilistic models that sequentially generate compositional structures through a stochastic policy. Among GFlowNets, temperature-conditional GFlowNets can introduce temperature-based controllability for exploration and…

Machine Learning · Computer Science 2024-06-04 Minsu Kim , Joohwan Ko , Taeyoung Yun , Dinghuai Zhang , Ling Pan , Woochang Kim , Jinkyoo Park , Emmanuel Bengio , Yoshua Bengio

This work applies Generative Flow Networks (GFlowNets) to three graph optimization problems: the Traveling Salesperson Problem, Minimum Spanning Tree, and Shortest Path. GFlowNets are generative models that learn to sample solutions…

Artificial Intelligence · Computer Science 2025-10-28 Mark Phillip Matovic

Humans are masters at quickly learning many complex tasks, relying on an approximate understanding of the dynamics of their environments. In much the same way, we would like our learning agents to quickly adapt to new tasks. In this paper,…

Reinforcement Learning (RL) has proven highly effective in addressing complex control and decision-making tasks. However, in most traditional RL algorithms, the policy is typically parameterized as a diagonal Gaussian distribution, which…

Machine Learning · Computer Science 2026-04-02 Ruijie Hao , Longfei Zhang , Yang Dai , Yang Ma , Xingxing Liang , Guangquan Cheng

Skin-friction drag induced by wall-bounded turbulent flows accounts for a substantial fraction of energy consumption across commercial aerospace, wind energy, and marine transport. Its active reduction is one of the highest-value targets in…

Fluid Dynamics · Physics 2026-05-15 Atharva Mahajan , Abhijeet Vishwasrao , Yuning Wang , Ricardo Vinuesa

Flow-matching policies have emerged as a powerful paradigm for generalist robotics. These models are trained to imitate an action chunk, conditioned on sensor observations and textual instructions. Often, training demonstrations are…

Machine Learning · Computer Science 2025-07-22 Samuel Pfrommer , Yixiao Huang , Somayeh Sojoudi

Reinforcement Learning (RL) is a general framework concerned with an agent that seeks to maximize rewards in an environment. The learning typically happens through trial and error using explorative methods, such as epsilon-greedy. There are…

Machine Learning · Computer Science 2022-10-06 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo