English
Related papers

Related papers: Learning to Scale Logits for Temperature-Condition…

200 papers

Generative flow networks (GFlowNets) are a family of algorithms that learn a generative policy to sample discrete objects $x$ with non-negative reward $R(x)$. Learning objectives guarantee the GFlowNet samples $x$ from the target…

Machine Learning · Computer Science 2023-05-15 Max W. Shen , Emmanuel Bengio , Ehsan Hajiramezanali , Andreas Loukas , Kyunghyun Cho , Tommaso Biancalani

The recently proposed generative flow networks (GFlowNets) are a method of training a policy to sample compositional discrete objects with probabilities proportional to a given reward via a sequence of actions. GFlowNets exploit the…

Machine Learning · Computer Science 2024-02-27 Daniil Tiapkin , Nikita Morozov , Alexey Naumov , Dmitry Vetrov

Generative flow networks (GFlowNets) are a method for learning a stochastic policy for generating compositional objects, such as graphs or strings, from a given unnormalized density by sequences of actions, where many possible action…

Machine Learning · Computer Science 2023-10-05 Nikolay Malkin , Moksh Jain , Emmanuel Bengio , Chen Sun , Yoshua Bengio

Generative Flow Networks (GFlowNets), a class of generative models have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from unnormalized reward distributions. Previous works…

Machine Learning · Computer Science 2024-09-17 Mohit Pandey , Gopeshh Subbaraj , Emmanuel Bengio

Generative flow networks (GFlowNets), as an emerging technique, can be used as an alternative to reinforcement learning for exploratory control tasks. GFlowNet aims to generate distribution proportional to the rewards over terminating…

Machine Learning · Computer Science 2023-03-07 Yinchuan Li , Shuang Luo , Haozhi Wang , Jianye Hao

Knowledge distillation is a technique to imitate a performance that a deep learning model has, but reduce the size on another model. It applies the outputs of a model to train another model having comparable accuracy. These two distinct…

Machine Learning · Computer Science 2025-03-13 Kazuhiro Matsuyama , Usman Anjum , Satoko Matsuyama , Tetsuo Shoda , Justin Zhan

Generative Flow Networks (GFlowNets) are powerful samplers for compositional objects that, by design, sample proportionally to a given non-negative reward. Nonetheless, in practice, they often struggle to explore the reward landscape…

Machine Learning · Computer Science 2026-03-17 Pedro Dall'Antonia , Tiago da Silva , Daniel Augusto de Souza , César Lincoln C. Mattos , Diego Mesquita

We present energy-based generative flow networks (EB-GFN), a novel probabilistic modeling algorithm for high-dimensional discrete data. Building upon the theory of generative flow networks (GFlowNets), we model the generation process by a…

Machine Learning · Computer Science 2022-06-10 Dinghuai Zhang , Nikolay Malkin , Zhen Liu , Alexandra Volokhova , Aaron Courville , Yoshua Bengio

Although Generative Flow Networks (GFlowNets) are designed to capture multiple modes of a reward function, they often suffer from mode collapse in practice, getting trapped in early-discovered modes and requiring prolonged training to find…

Machine Learning · Computer Science 2025-11-11 Idriss Malek , Aya Laajil , Abhijith Sharma , Eric Moulines , Salem Lahlou

Generative Flow Networks (GFlowNets) learn to sample diverse candidates in proportion to a reward function, making them well-suited for scientific discovery, where exploring multiple promising solutions is crucial. Further extending…

Machine Learning · Computer Science 2026-05-29 Seokwon Yoon , Youngbin Choi , Seunghyuk Cho , Seungbeom Lee , MoonJeong Park , Dongwoo Kim

Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates with probabilities proportional to a given reward. However, GFlowNets can only be used with a predefined scalar reward, which can be…

Machine Learning · Computer Science 2024-02-27 Yihang Chen , Lukas Mauch

In our prior work we have proposed the use of GFlowNets, a generative AI (GenAI) framework, for designing a secure communication system comprising a time-modulated intelligent reflecting surface (TM-IRS). However, GFlowNet-based approaches…

Signal Processing · Electrical Eng. & Systems 2025-11-11 Zhihao Tao , Athina P. Petropulu

This paper is about the problem of learning a stochastic policy for generating an object (like a molecular graph) from a sequence of actions, such that the probability of generating an object is proportional to a given positive reward for…

Machine Learning · Computer Science 2021-11-22 Emmanuel Bengio , Moksh Jain , Maksym Korablyov , Doina Precup , Yoshua Bengio

Generative Flow Networks (GFlowNets) learn to sample states proportional to an unnormalized reward. Despite their theoretical promise, practical training is often unstable, exhibiting severe loss spikes and mode collapse. To tackle this, we…

Federated learning is inherently hampered by data heterogeneity: non-i.i.d. training data over local clients. We propose a novel model training approach for federated learning, FLex&Chill, which exploits the Logit Chilling method. Through…

Machine Learning · Computer Science 2025-12-24 Kichang Lee , Pei Zhang , Songkuk Kim , JeongGil Ko

Multi-task reinforcement learning and meta-reinforcement learning have been developed to quickly adapt to new tasks, but they tend to focus on tasks with higher rewards and more frequent occurrences, leading to poor performance on tasks…

Machine Learning · Computer Science 2023-06-19 Xinyuan Ji , Xu Zhang , Wei Xi , Haozhi Wang , Olga Gadyatskaya , Yinchuan Li

In this work, we consider the radio resource allocation problem in a wireless system with various integrated functionalities, such as communication, sensing and computing. We design suitable resource management techniques that can…

Machine Learning · Computer Science 2025-05-09 Charbel Bou Chaaya , Mehdi Bennis

Generative Flow Networks (GFlowNets) are a family of probabilistic generative models that learn to sample compositional objects proportional to their rewards. One big challenge of GFlowNets is training them effectively when dealing with…

Machine Learning · Computer Science 2025-06-16 Zarif Ikram , Ling Pan , Dianbo Liu

The troposphere is one of the atmospheric layers where most weather phenomena occur. Temperature variations in the troposphere, especially at 500 hPa, a typical level of the middle troposphere, are significant indicators of future weather…

Machine Learning · Computer Science 2021-07-16 Zhihao Chen , Jie Gao , Weikai Wang , Zheng Yan

In GFlowNets and variational inference, it has been shown that the mean square error between target and model log probabilities is an effective, low variance, surrogate loss for training generative models. This loss has the property that…

Machine Learning · Computer Science 2026-05-18 Jake Fawkes , Jason Hartford