English
Related papers

Related papers: Evaluating GFlowNet from partial episodes for stab…

200 papers

Multi-task reinforcement learning and meta-reinforcement learning have been developed to quickly adapt to new tasks, but they tend to focus on tasks with higher rewards and more frequent occurrences, leading to poor performance on tasks…

Machine Learning · Computer Science 2023-06-19 Xinyuan Ji , Xu Zhang , Wei Xi , Haozhi Wang , Olga Gadyatskaya , Yinchuan Li

Generative Flow Networks (GFlowNets) aim to generate diverse trajectories from a distribution in which the final states of the trajectories are proportional to the reward, serving as a powerful alternative to reinforcement learning for…

Artificial Intelligence · Computer Science 2024-08-14 Shuang Luo , Yinchuan Li , Shunyu Liu , Xu Zhang , Yunfeng Shao , Chao Wu

This paper studies generative flow networks (GFlowNets) to sample objects from the Boltzmann energy distribution via a sequence of actions. In particular, we focus on improving GFlowNet with partial inference: training flow functions with…

Machine Learning · Computer Science 2023-10-06 Hyosoon Jang , Minsu Kim , Sungsoo Ahn

Generative Flow Networks (GFlowNets) have shown promising potential to generate high-scoring candidates with probability proportional to their rewards. As existing GFlowNets freely explore in state space, they encounter significant…

Machine Learning · Computer Science 2026-02-13 Xuan Yu , Xu Wang , Rui Zhu , Yudong Zhang , Yang Wang

This paper studies Generative Flow Networks (GFlowNets), which learn to sample objects proportionally to a given reward function through the trajectory of state transitions. In this work, we observe that GFlowNets tend to under-exploit the…

Machine Learning · Computer Science 2024-10-30 Hyosoon Jang , Yunhui Jang , Minsu Kim , Jinkyoo Park , Sungsoo Ahn

Generative Flow Networks for continuous scenarios (CFlowNets) have shown promise in solving sequential decision-making tasks by learning stochastic policies using a flow and a retrieval network. Despite their demonstrated efficiency…

Machine Learning · Computer Science 2026-03-19 Zahin Sufiyan , Shadan Golestan , Yoshihiro Mitsuka , Shotaro Miwa , Osmar Zaiane

Reliable value estimation serves as the cornerstone of reinforcement learning (RL) by evaluating long-term returns and guiding policy improvement, significantly influencing the convergence speed and final performance. Existing works improve…

Machine Learning · Computer Science 2025-10-28 Shan Zhong , Shutong Ding , He Diao , Xiangyu Wang , Kah Chan Teh , Bei Peng

Generative Flow Networks (GFlowNets), a new family of probabilistic samplers, have demonstrated remarkable capabilities to generate diverse sets of high-reward candidates, in contrast to standard return maximization approaches (e.g.,…

Machine Learning · Computer Science 2025-02-25 Haoran He , Can Chang , Huazhe Xu , Ling Pan

This work applies Generative Flow Networks (GFlowNets) to three graph optimization problems: the Traveling Salesperson Problem, Minimum Spanning Tree, and Shortest Path. GFlowNets are generative models that learn to sample solutions…

Artificial Intelligence · Computer Science 2025-10-28 Mark Phillip Matovic

We tackle the problem of sampling from intractable high-dimensional density functions, a fundamental task that often appears in machine learning and statistics. We extend recent sampling-based approaches that leverage controlled stochastic…

Machine Learning · Computer Science 2024-03-12 Dinghuai Zhang , Ricky T. Q. Chen , Cheng-Hao Liu , Aaron Courville , Yoshua Bengio

Generative Flow Network (GFlowNet) objectives implicitly fix an equal mixing of forward and backward policies, potentially constraining the exploration-exploitation trade-off during training. By further exploring the link between GFlowNets…

Artificial Intelligence · Computer Science 2026-02-27 Lin Chen , Samuel Drapeau , Fanghao Shao , Xuekai Zhu , Bo Xue , Yunchong Song , Mathieu Laurière , Zhouhan Lin

In this work, we consider the radio resource allocation problem in a wireless system with various integrated functionalities, such as communication, sensing and computing. We design suitable resource management techniques that can…

Machine Learning · Computer Science 2025-05-09 Charbel Bou Chaaya , Mehdi Bennis

Generative Flow Networks (GFlowNets) excel at sampling diverse, high-reward objects. In many practical applications where active reward queries are infeasible, these models must be trained using static offline datasets. Prevailing training…

Machine Learning · Computer Science 2026-05-26 Ruishuo Chen , Xun Wang , Rui Hu , Zhuoran Li , Longbo Huang

In GFlowNets and variational inference, it has been shown that the mean square error between target and model log probabilities is an effective, low variance, surrogate loss for training generative models. This loss has the property that…

Machine Learning · Computer Science 2026-05-18 Jake Fawkes , Jason Hartford

This paper builds bridges between two families of probabilistic algorithms: (hierarchical) variational inference (VI), which is typically used to model distributions over continuous spaces, and generative flow networks (GFlowNets), which…

Machine Learning · Computer Science 2023-03-03 Nikolay Malkin , Salem Lahlou , Tristan Deleu , Xu Ji , Edward Hu , Katie Everett , Dinghuai Zhang , Yoshua Bengio

Offline reinforcement learning often relies on behavior regularization that enforces policies to remain close to the dataset distribution. However, such approaches fail to distinguish between high-value and low-value actions in their…

We present energy-based generative flow networks (EB-GFN), a novel probabilistic modeling algorithm for high-dimensional discrete data. Building upon the theory of generative flow networks (GFlowNets), we model the generation process by a…

Machine Learning · Computer Science 2022-06-10 Dinghuai Zhang , Nikolay Malkin , Zhen Liu , Alexandra Volokhova , Aaron Courville , Yoshua Bengio

While Markov chain Monte Carlo methods (MCMC) provide a general framework to sample from a probability distribution defined up to normalization, they often suffer from slow convergence to the target distribution when the latter is highly…

Machine Learning · Computer Science 2023-07-06 Tristan Deleu , Yoshua Bengio

Mathematical reasoning problems are among the most challenging, as they typically require an understanding of fundamental laws to solve. The laws are universal, but the derivation of the final answer changes depending on how a problem is…

Machine Learning · Computer Science 2024-10-29 Ryoichi Takase , Masaya Tsunokake , Yuta Tsuchiya , Shota Inuzuka

Generative flow networks (GFlowNets) are sequential sampling models trained to match a given distribution. GFlowNets have been successfully applied to various structured object generation tasks, sampling a diverse set of high-reward objects…

Machine Learning · Computer Science 2024-03-15 Marco Jiralerspong , Bilun Sun , Danilo Vucetic , Tianyu Zhang , Yoshua Bengio , Gauthier Gidel , Nikolay Malkin