English
Related papers

Related papers: Generative Flow Networks as Entropy-Regularized RL

200 papers

Generative control policies have recently unlocked major progress in robotics. These methods produce action sequences via diffusion or flow matching, with training data provided by demonstrations. But existing methods come with two key…

Robotics · Computer Science 2026-03-09 Vince Kurtz , Joel W. Burdick

Generative Flow Networks (GFlowNets) have demonstrated significant performance improvements for generating diverse discrete objects $x$ given a reward function $R(x)$, indicating the utility of the object and trained independently from the…

Machine Learning · Computer Science 2022-11-03 Chanakya Ekbote , Moksh Jain , Payel Das , Yoshua Bengio

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over the years. Existing literature mainly focus on selecting a subgraph, through combinatorial optimization, to provide faithful…

Machine Learning · Computer Science 2023-03-07 Wenqian Li , Yinchuan Li , Zhigang Li , Jianye Hao , Yan Pang

Generative Flow Networks (GFlowNets; GFNs) are a class of generative models that learn to sample compositional objects proportionally to their a priori unknown value, their reward. We focus on the case where the reward has a specified,…

Machine Learning · Computer Science 2026-05-12 Alexandre Larouche , Audrey Durand

Personalized recommender systems fulfill the daily demands of customers and boost online businesses. The goal is to learn a policy that can generate a list of items that matches the user's demand or interest. While most existing methods…

Information Retrieval · Computer Science 2023-06-12 Shuchang Liu , Qingpeng Cai , Zhankui He , Bowen Sun , Julian McAuley , Dong Zheng , Peng Jiang , Kun Gai

Generative flow networks (GFNs) are a class of models for sequential sampling of composite objects, which approximate a target distribution that is defined in terms of an energy function or a reward. GFNs are typically trained using a flow…

Machine Learning · Statistics 2022-10-17 Heiko Zimmermann , Fredrik Lindsten , Jan-Willem van de Meent , Christian A. Naesseth

Generative Flow Networks (GFlowNets) are amortized inference models designed to sample from unnormalized distributions over composable objects, with applications in generative modeling for tasks in fields such as causal discovery, NLP, and…

Machine Learning · Computer Science 2026-04-13 Tiago da Silva , Eliezer de Souza da Silva , Diego Mesquita

Generative flow networks (GFlowNets) are sequential sampling models trained to match a given distribution. GFlowNets have been successfully applied to various structured object generation tasks, sampling a diverse set of high-reward objects…

Machine Learning · Computer Science 2024-03-15 Marco Jiralerspong , Bilun Sun , Danilo Vucetic , Tianyu Zhang , Yoshua Bengio , Gauthier Gidel , Nikolay Malkin

This paper builds bridges between two families of probabilistic algorithms: (hierarchical) variational inference (VI), which is typically used to model distributions over continuous spaces, and generative flow networks (GFlowNets), which…

Machine Learning · Computer Science 2023-03-03 Nikolay Malkin , Salem Lahlou , Tristan Deleu , Xu Ji , Edward Hu , Katie Everett , Dinghuai Zhang , Yoshua Bengio

Generative recommendations (GR), which usually include item tokenizers and generative Large Language Models (LLMs), have demonstrated remarkable success across a wide range of scenarios. The majority of existing research efforts primarily…

Information Retrieval · Computer Science 2025-11-25 Yejing Wang , Shengyu Zhou , Jinyu Lu , Qidong Liu , Xinhang Li , Wenlin Zhang , Feng Li , Pengjie Wang , Jian Xu , Bo Zheng , Xiangyu Zhao

Symbolic regression (SR) is an area of interpretable machine learning that aims to identify mathematical expressions, often composed of simple functions, that best fit in a given set of covariates $X$ and response $y$. In recent years, deep…

Machine Learning · Computer Science 2023-12-04 Sida Li , Ioana Marinescu , Sebastian Musslick

This paper presents a novel generative model to synthesize fluid simulations from a set of reduced parameters. A convolutional neural network is trained on a collection of discrete, parameterizable fluid simulation velocity fields. Due to…

Machine Learning · Computer Science 2019-09-05 Byungsoo Kim , Vinicius C. Azevedo , Nils Thuerey , Theodore Kim , Markus Gross , Barbara Solenthaler

Social goods, such as healthcare, smart city, and information networks, often produce ordered event data in continuous time. The generative processes of these event data can be very complex, requiring flexible models to capture their…

Machine Learning · Computer Science 2020-12-29 Shuang Li , Shuai Xiao , Shixiang Zhu , Nan Du , Yao Xie , Le Song

Generative Flow Networks (GFlowNets) have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from rewards treated as unnormalized distributions. Previous works in this framework…

Machine Learning · Computer Science 2025-06-13 Mohit Pandey , Gopeshh Subbaraj , Artem Cherkasov , Martin Ester , Emmanuel Bengio

Reinforcement Learning (RL) algorithms aim to learn an optimal policy by iteratively sampling actions to learn how to maximize the total expected return, $R(x)$. GFlowNets are a special class of algorithms designed to generate diverse…

Machine Learning · Computer Science 2023-07-19 Nikhil Vemgal , Elaine Lau , Doina Precup

Generative Flow Networks (GFlowNets) aim to generate diverse trajectories from a distribution in which the final states of the trajectories are proportional to the reward, serving as a powerful alternative to reinforcement learning for…

Artificial Intelligence · Computer Science 2024-08-14 Shuang Luo , Yinchuan Li , Shunyu Liu , Xu Zhang , Yunfeng Shao , Chao Wu

Reinforcement learning has gained traction for active flow control tasks, with initial applications exploring drag mitigation via flow field augmentation around a two-dimensional cylinder. RL has since been extended to more complex…

Machine Learning · Computer Science 2025-04-01 Marius Kurz , Rohan Kaushik , Marcel Blind , Patrick Kopper , Anna Schwarz , Felix Rodach , Andrea Beck

GFlowNets are a promising alternative to MCMC sampling for discrete compositional random variables. Training GFlowNets requires repeated evaluations of the unnormalized target distribution or reward function. However, for large-scale…

Machine Learning · Computer Science 2024-06-06 Tiago da Silva , Luiz Max Carvalho , Amauri Souza , Samuel Kaski , Diego Mesquita

Normalizing flows are exact-likelihood generative neural networks which approximately transform samples from a simple prior distribution to samples of the probability distribution of interest. Recent work showed that such generative models…

Machine Learning · Statistics 2020-10-27 Jonas Köhler , Leon Klein , Frank Noé

Generative Flow Networks (GFlowNets) enable structured generation with inherent diversity, but existing sampling strategies often rely on weak guided exploration, slowing early discovery of high-reward candidates. In tasks such as molecular…

Machine Learning · Computer Science 2026-02-03 Rui Zhu , Yudong Zhang , Xuan Yu , Chen Zhang , Xu Wang , Yang Wang