English
Related papers

Related papers: Thompson sampling for improved exploration in GFlo…

200 papers

Latent variable models (LVMs) with discrete compositional latents are an important but challenging setting due to a combinatorially large number of possible configurations of the latents. A key tradeoff in modeling the posteriors over…

Machine Learning · Computer Science 2023-06-06 Edward J. Hu , Nikolay Malkin , Moksh Jain , Katie Everett , Alexandros Graikos , Yoshua Bengio

Generative Flow Networks (GFlowNets; GFNs) are a class of generative models that learn to sample compositional objects proportionally to their a priori unknown value, their reward. We focus on the case where the reward has a specified,…

Machine Learning · Computer Science 2026-05-12 Alexandre Larouche , Audrey Durand

Generative flow networks (GFlowNets) are sequential sampling models trained to match a given distribution. GFlowNets have been successfully applied to various structured object generation tasks, sampling a diverse set of high-reward objects…

Machine Learning · Computer Science 2024-03-15 Marco Jiralerspong , Bilun Sun , Danilo Vucetic , Tianyu Zhang , Yoshua Bengio , Gauthier Gidel , Nikolay Malkin

Linear diffusion processes serve as canonical continuous-time models for dynamic decision-making under uncertainty. These systems evolve according to drift matrices that specify the instantaneous rates of change in the expected system…

Machine Learning · Computer Science 2025-06-10 Mohamad Kazem Shirani Faradonbeh , Sadegh Shirani , Mohsen Bayati

Achieving chemical accuracy in quantum simulations is often constrained by the measurement bottleneck: estimating operators requires a large number of shots, which remains costly even on fault-tolerant devices and is further exacerbated on…

Quantum Physics · Physics 2025-09-22 Isaac L. Huidobro-Meezs , Jun Dai , Rodrigo A. Vargas-Hernández

In this work, we consider the radio resource allocation problem in a wireless system with various integrated functionalities, such as communication, sensing and computing. We design suitable resource management techniques that can…

Machine Learning · Computer Science 2025-05-09 Charbel Bou Chaaya , Mehdi Bennis

Generative Flow Networks (GFlowNets), a class of generative models have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from unnormalized reward distributions. Previous works…

Machine Learning · Computer Science 2024-09-17 Mohit Pandey , Gopeshh Subbaraj , Emmanuel Bengio

Generative Flow Networks or GFlowNets are related to Monte-Carlo Markov chain methods (as they sample from a distribution specified by an energy function), reinforcement learning (as they learn a policy to sample composed objects through a…

Machine Learning · Computer Science 2023-06-21 Ling Pan , Nikolay Malkin , Dinghuai Zhang , Yoshua Bengio

Recent studies suggest utilizing generative models instead of traditional auto-regressive algorithms for time series forecasting (TSF) tasks. These non-auto-regressive approaches involving different generative methods, including GAN,…

Machine Learning · Computer Science 2025-03-19 Jiangxuan Long , Zhao Song , Chiwun Yang

Many interventions, such as vaccines in clinical trials or coupons in online marketplaces, must be assigned sequentially without full knowledge of their effects. Multi-armed bandit algorithms have proven successful in such settings.…

Machine Learning · Statistics 2026-05-07 Aidan Gleich , Eric Laber , Alexander Volfovsky

Generative Flow Networks (GFlowNets), a class of generative models over discrete and structured sample spaces, have been previously applied to the problem of inferring the marginal posterior distribution over the directed acyclic graph…

We introduce a framework for Thompson sampling (TS) contextual bandit algorithms, in which the algorithm's ability to quantify uncertainty and make decisions depends on the quality of a generative model that is learned offline. Instead of…

Machine Learning · Computer Science 2025-11-13 Kelly W. Zhang , Tiffany Tianhui Cai , Hongseok Namkoong , Daniel Russo

We present a novel extension of Thompson Sampling for stochastic sequential decision problems with graph feedback, even when the graph structure itself is unknown and/or changing. We provide theoretical guarantees on the Bayesian regret of…

Machine Learning · Computer Science 2017-01-17 Aristide C. Y. Tossou , Christos Dimitrakakis , Devdatt Dubhashi

The Generative Flow Network (GFlowNet) is a probabilistic framework in which an agent learns a stochastic policy and flow functions to sample objects proportionally to an unnormalized reward function. A number of recent works explored…

Machine Learning · Computer Science 2025-06-03 Haoran He , Emmanuel Bengio , Qingpeng Cai , Ling Pan

Reinforcement Learning (RL) algorithms aim to learn an optimal policy by iteratively sampling actions to learn how to maximize the total expected return, $R(x)$. GFlowNets are a special class of algorithms designed to generate diverse…

Machine Learning · Computer Science 2023-07-19 Nikhil Vemgal , Elaine Lau , Doina Precup

Generative Flow Network (GFlowNet) objectives implicitly fix an equal mixing of forward and backward policies, potentially constraining the exploration-exploitation trade-off during training. By further exploring the link between GFlowNets…

Artificial Intelligence · Computer Science 2026-02-27 Lin Chen , Samuel Drapeau , Fanghao Shao , Xuekai Zhu , Bo Xue , Yunchong Song , Mathieu Laurière , Zhouhan Lin

Multi-task reinforcement learning and meta-reinforcement learning have been developed to quickly adapt to new tasks, but they tend to focus on tasks with higher rewards and more frequent occurrences, leading to poor performance on tasks…

Machine Learning · Computer Science 2023-06-19 Xinyuan Ji , Xu Zhang , Wei Xi , Haozhi Wang , Olga Gadyatskaya , Yinchuan Li

We consider an online decision-making problem with a reward function defined over graph-structured data. We formally formulate the problem as an instance of graph action bandit. We then propose \texttt{GNN-TS}, a Graph Neural Network (GNN)…

Machine Learning · Computer Science 2024-06-24 Shuang Wu , Arash A. Amini

In algorithm optimization in reinforcement learning, how to deal with the exploration-exploitation dilemma is particularly important. Multi-armed bandit problem can optimize the proposed solutions by changing the reward distribution to…

Machine Learning · Statistics 2022-03-28 Zhendong Shi , Ercan E. Kuruoglu , Xiaoli Wei

This paper proposes a supervised training algorithm for learning stochastic resource allocation policies with generative diffusion models (GDMs). We formulate the allocation problem as the maximization of an ergodic utility function subject…

Machine Learning · Computer Science 2025-09-23 Yigit Berkay Uslu , Samar Hadou , Shirin Saeedi Bidokhti , Alejandro Ribeiro
‹ Prev 1 3 4 5 6 7 10 Next ›