English
Related papers

Related papers: Optimizing Backward Policies in GFlowNets via Traj…

200 papers

Generative Flow Networks (GFlowNets), a new family of probabilistic samplers, have recently emerged as a promising framework for learning stochastic policies that generate high-quality and diverse objects proportionally to their rewards.…

Machine Learning · Computer Science 2024-06-05 Chunhui Li , Cheng-Hao Liu , Dianbo Liu , Qingpeng Cai , Ling Pan

Generative Flow Networks for continuous scenarios (CFlowNets) have shown promise in solving sequential decision-making tasks by learning stochastic policies using a flow and a retrieval network. Despite their demonstrated efficiency…

Machine Learning · Computer Science 2026-03-19 Zahin Sufiyan , Shadan Golestan , Yoshihiro Mitsuka , Shotaro Miwa , Osmar Zaiane

Reinforcement Learning (RL) algorithms aim to learn an optimal policy by iteratively sampling actions to learn how to maximize the total expected return, $R(x)$. GFlowNets are a special class of algorithms designed to generate diverse…

Machine Learning · Computer Science 2023-07-19 Nikhil Vemgal , Elaine Lau , Doina Precup

Generative Flow Networks (GFlowNets) treat sampling from distributions over compositional discrete spaces as a sequential decision-making problem, training a stochastic policy to construct objects step by step. Recent studies have revealed…

Machine Learning · Computer Science 2024-06-21 Nikita Morozov , Daniil Tiapkin , Sergey Samsonov , Alexey Naumov , Dmitry Vetrov

Personalized recommender systems fulfill the daily demands of customers and boost online businesses. The goal is to learn a policy that can generate a list of items that matches the user's demand or interest. While most existing methods…

Information Retrieval · Computer Science 2023-06-12 Shuchang Liu , Qingpeng Cai , Zhankui He , Bowen Sun , Julian McAuley , Dong Zheng , Peng Jiang , Kun Gai

Generative Flow Networks (GFlowNets) are amortized inference models designed to sample from unnormalized distributions over composable objects, with applications in generative modeling for tasks in fields such as causal discovery, NLP, and…

Machine Learning · Computer Science 2026-04-13 Tiago da Silva , Eliezer de Souza da Silva , Diego Mesquita

Generative Flow Networks (GFlowNets; GFNs) are a family of energy-based generative methods for combinatorial objects, capable of generating diverse and high-utility samples. However, consistently biasing GFNs towards producing high-utility…

Machine Learning · Computer Science 2024-11-04 Elaine Lau , Stephen Zhewen Lu , Ling Pan , Doina Precup , Emmanuel Bengio

A critical component of the current generation of language models is preference alignment, which aims to precisely control the model's behavior to meet human needs and values. The most notable among such methods is Reinforcement Learning…

Artificial Intelligence · Computer Science 2024-10-22 Oh Joon Kwon , Daiki E. Matsunaga , Kee-Eung Kim

While Markov chain Monte Carlo methods (MCMC) provide a general framework to sample from a probability distribution defined up to normalization, they often suffer from slow convergence to the target distribution when the latter is highly…

Machine Learning · Computer Science 2023-07-06 Tristan Deleu , Yoshua Bengio

Generative Flow Network (GFlowNet) objectives implicitly fix an equal mixing of forward and backward policies, potentially constraining the exploration-exploitation trade-off during training. By further exploring the link between GFlowNets…

Artificial Intelligence · Computer Science 2026-02-27 Lin Chen , Samuel Drapeau , Fanghao Shao , Xuekai Zhu , Bo Xue , Yunchong Song , Mathieu Laurière , Zhouhan Lin

We present GFlowState, a visual analytics system designed to illuminate the training process of Generative Flow Networks (GFlowNets or GFNs). GFlowNets are a probabilistic framework for generating samples proportionally to a reward…

Machine Learning · Computer Science 2026-04-24 Florian Holeczek , Andreas Hinterreiter , Alex Hernandez-Garcia , Marc Streit , Christina Humer

Due to limited resources and fast economic growth, designing optimal transportation road networks with traffic simulation and validation in a cost-effective manner is vital for developing countries, where extensive manual testing is…

Artificial Intelligence · Computer Science 2023-10-06 Zarif Ikram , Ling Pan , Dianbo Liu

Generative Flow Networks (GFlowNets) learn to sample states proportional to an unnormalized reward. Despite their theoretical promise, practical training is often unstable, exhibiting severe loss spikes and mode collapse. To tackle this, we…

Likelihood-based policy gradient methods are the dominant approach for training robot control policies from rewards. These methods rely on differentiable action likelihoods, which constrain policy outputs to simple distributions like…

Generative Flow Networks (GFlowNets) enable structured generation with inherent diversity, but existing sampling strategies often rely on weak guided exploration, slowing early discovery of high-reward candidates. In tasks such as molecular…

Machine Learning · Computer Science 2026-02-03 Rui Zhu , Yudong Zhang , Xuan Yu , Chen Zhang , Xu Wang , Yang Wang

Flow-matching policies have emerged as a powerful paradigm for generalist robotics. These models are trained to imitate an action chunk, conditioned on sensor observations and textual instructions. Often, training demonstrations are…

Machine Learning · Computer Science 2025-07-22 Samuel Pfrommer , Yixiao Huang , Somayeh Sojoudi

The challenge of discovering new molecules with desired properties is crucial in domains like drug discovery and material design. Recent advances in deep learning-based generative methods have shown promise but face the issue of sample…

Biomolecules · Quantitative Biology 2024-12-31 Hyeonah Kim , Minsu Kim , Sanghyeok Choi , Jinkyoo Park

Generative recommendations (GR), which usually include item tokenizers and generative Large Language Models (LLMs), have demonstrated remarkable success across a wide range of scenarios. The majority of existing research efforts primarily…

Information Retrieval · Computer Science 2025-11-25 Yejing Wang , Shengyu Zhou , Jinyu Lu , Qidong Liu , Xinhang Li , Wenlin Zhang , Feng Li , Pengjie Wang , Jian Xu , Bo Zheng , Xiangyu Zhao

We present energy-based generative flow networks (EB-GFN), a novel probabilistic modeling algorithm for high-dimensional discrete data. Building upon the theory of generative flow networks (GFlowNets), we model the generation process by a…

Machine Learning · Computer Science 2022-06-10 Dinghuai Zhang , Nikolay Malkin , Zhen Liu , Alexandra Volokhova , Aaron Courville , Yoshua Bengio

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over the years. Existing literature mainly focus on selecting a subgraph, through combinatorial optimization, to provide faithful…

Machine Learning · Computer Science 2023-03-07 Wenqian Li , Yinchuan Li , Zhigang Li , Jianye Hao , Yan Pang