English
Related papers

Related papers: BatchGFN: Generative Flow Networks for Batch Activ…

200 papers

Generative flow networks (GFlowNets), as an emerging technique, can be used as an alternative to reinforcement learning for exploratory control tasks. GFlowNet aims to generate distribution proportional to the rewards over terminating…

Machine Learning · Computer Science 2023-03-07 Yinchuan Li , Shuang Luo , Haozhi Wang , Jianye Hao

Data generation and labeling are often expensive in robot learning. Preference-based learning is a concept that enables reliable labeling by querying users with preference questions. Active querying methods are commonly employed in…

Machine Learning · Computer Science 2024-02-27 Erdem Bıyık , Nima Anari , Dorsa Sadigh

This paper studies Generative Flow Networks (GFlowNets), which learn to sample objects proportionally to a given reward function through the trajectory of state transitions. In this work, we observe that GFlowNets tend to under-exploit the…

Machine Learning · Computer Science 2024-10-30 Hyosoon Jang , Yunhui Jang , Minsu Kim , Jinkyoo Park , Sungsoo Ahn

We consider a batch active learning scenario where the learner adaptively issues batches of points to a labeling oracle. Sampling labels in batches is highly desirable in practice due to the smaller number of interactive rounds with the…

Machine Learning · Computer Science 2022-06-14 Claudio Gentile , Zhilei Wang , Tong Zhang

Generative Flow Networks (GFlowNets) aim to generate diverse trajectories from a distribution in which the final states of the trajectories are proportional to the reward, serving as a powerful alternative to reinforcement learning for…

Artificial Intelligence · Computer Science 2024-08-14 Shuang Luo , Yinchuan Li , Shunyu Liu , Xu Zhang , Yunfeng Shao , Chao Wu

Generative Flow Networks (GFlowNets), a class of generative models have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from unnormalized reward distributions. Previous works…

Machine Learning · Computer Science 2024-09-17 Mohit Pandey , Gopeshh Subbaraj , Emmanuel Bengio

This paper is about the problem of learning a stochastic policy for generating an object (like a molecular graph) from a sequence of actions, such that the probability of generating an object is proportional to a given positive reward for…

Machine Learning · Computer Science 2021-11-22 Emmanuel Bengio , Moksh Jain , Maksym Korablyov , Doina Precup , Yoshua Bengio

Generative Flow Networks (GFlowNets) have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from rewards treated as unnormalized distributions. Previous works in this framework…

Machine Learning · Computer Science 2025-06-13 Mohit Pandey , Gopeshh Subbaraj , Artem Cherkasov , Martin Ester , Emmanuel Bengio

We present BatchGNN, a distributed CPU system that showcases techniques that can be used to efficiently train GNNs on terabyte-sized graphs. It reduces communication overhead with macrobatching in which multiple minibatches' subgraph…

Machine Learning · Computer Science 2023-06-27 Loc Hoang , Rita Brugarolas Brufau , Ke Ding , Bo Wu

Generative flow networks (GFlowNets) are a family of algorithms for training a sequential sampler of discrete objects under an unnormalized target density and have been successfully used for various probabilistic modeling tasks. Existing…

Although Generative Flow Networks (GFlowNets) are designed to capture multiple modes of a reward function, they often suffer from mode collapse in practice, getting trapped in early-discovered modes and requiring prolonged training to find…

Machine Learning · Computer Science 2025-11-11 Idriss Malek , Aya Laajil , Abhijith Sharma , Eric Moulines , Salem Lahlou

This paper presents a novel generative model to synthesize fluid simulations from a set of reduced parameters. A convolutional neural network is trained on a collection of discrete, parameterizable fluid simulation velocity fields. Due to…

Machine Learning · Computer Science 2019-09-05 Byungsoo Kim , Vinicius C. Azevedo , Nils Thuerey , Theodore Kim , Markus Gross , Barbara Solenthaler

Generative Flow Networks (GFlowNets) are amortized samplers that learn stochastic policies to sequentially generate compositional objects from a given unnormalized reward distribution. They can generate diverse sets of high-reward objects,…

Machine Learning · Computer Science 2023-10-06 Ling Pan , Moksh Jain , Kanika Madan , Yoshua Bengio

Generative Flow Networks (GFlowNets) are amortized sampling methods that learn a distribution over discrete objects proportional to their rewards. GFlowNets exhibit a remarkable ability to generate diverse samples, yet occasionally struggle…

Machine Learning · Computer Science 2024-03-26 Minsu Kim , Taeyoung Yun , Emmanuel Bengio , Dinghuai Zhang , Yoshua Bengio , Sungsoo Ahn , Jinkyoo Park

We present energy-based generative flow networks (EB-GFN), a novel probabilistic modeling algorithm for high-dimensional discrete data. Building upon the theory of generative flow networks (GFlowNets), we model the generation process by a…

Machine Learning · Computer Science 2022-06-10 Dinghuai Zhang , Nikolay Malkin , Zhen Liu , Alexandra Volokhova , Aaron Courville , Yoshua Bengio

Generative machine learning has emerged as a powerful tool for design representation and exploration. However, its application is often constrained by the need for large datasets of existing designs and the lack of interpretability about…

Machine Learning · Computer Science 2025-08-13 Eric Seng , Hugh O'Connor , Adam Boyce , Josh J. Bailey , Anton van Beek

Active learning enables efficient model training by leveraging interactions between machine learning agents and human annotators. We study and propose a novel framework that formulates batch active learning from the sparse approximation's…

Machine Learning · Computer Science 2022-11-08 Maohao Shen , Bowen Jiang , Jacky Yibo Zhang , Oluwasanmi Koyejo

We develop BatchBALD, a tractable approximation to the mutual information between a batch of points and model parameters, which we use as an acquisition function to select multiple informative points jointly for the task of deep Bayesian…

Machine Learning · Computer Science 2019-10-29 Andreas Kirsch , Joost van Amersfoort , Yarin Gal

Leveraging the wealth of unlabeled data produced in recent years provides great potential for improving supervised models. When the cost of acquiring labels is high, probabilistic active learning methods can be used to greedily select the…

Machine Learning · Statistics 2021-02-09 Robert Pinsler , Jonathan Gordon , Eric Nalisnick , José Miguel Hernández-Lobato

Generative flow networks (GFlowNets) are a method for learning a stochastic policy for generating compositional objects, such as graphs or strings, from a given unnormalized density by sequences of actions, where many possible action…

Machine Learning · Computer Science 2023-10-05 Nikolay Malkin , Moksh Jain , Emmanuel Bengio , Chen Sun , Yoshua Bengio