中文
相关论文

相关论文: Thompson sampling for improved exploration in GFlo…

200 篇论文

Latent variable models (LVMs) with discrete compositional latents are an important but challenging setting due to a combinatorially large number of possible configurations of the latents. A key tradeoff in modeling the posteriors over…

机器学习 · 计算机科学 2023-06-06 Edward J. Hu , Nikolay Malkin , Moksh Jain , Katie Everett , Alexandros Graikos , Yoshua Bengio

Generative Flow Networks (GFlowNets; GFNs) are a class of generative models that learn to sample compositional objects proportionally to their a priori unknown value, their reward. We focus on the case where the reward has a specified,…

机器学习 · 计算机科学 2026-05-12 Alexandre Larouche , Audrey Durand

Generative flow networks (GFlowNets) are sequential sampling models trained to match a given distribution. GFlowNets have been successfully applied to various structured object generation tasks, sampling a diverse set of high-reward objects…

机器学习 · 计算机科学 2024-03-15 Marco Jiralerspong , Bilun Sun , Danilo Vucetic , Tianyu Zhang , Yoshua Bengio , Gauthier Gidel , Nikolay Malkin

Linear diffusion processes serve as canonical continuous-time models for dynamic decision-making under uncertainty. These systems evolve according to drift matrices that specify the instantaneous rates of change in the expected system…

机器学习 · 计算机科学 2025-06-10 Mohamad Kazem Shirani Faradonbeh , Sadegh Shirani , Mohsen Bayati

Achieving chemical accuracy in quantum simulations is often constrained by the measurement bottleneck: estimating operators requires a large number of shots, which remains costly even on fault-tolerant devices and is further exacerbated on…

量子物理 · 物理学 2025-09-22 Isaac L. Huidobro-Meezs , Jun Dai , Rodrigo A. Vargas-Hernández

In this work, we consider the radio resource allocation problem in a wireless system with various integrated functionalities, such as communication, sensing and computing. We design suitable resource management techniques that can…

机器学习 · 计算机科学 2025-05-09 Charbel Bou Chaaya , Mehdi Bennis

Generative Flow Networks (GFlowNets), a class of generative models have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from unnormalized reward distributions. Previous works…

机器学习 · 计算机科学 2024-09-17 Mohit Pandey , Gopeshh Subbaraj , Emmanuel Bengio

Generative Flow Networks or GFlowNets are related to Monte-Carlo Markov chain methods (as they sample from a distribution specified by an energy function), reinforcement learning (as they learn a policy to sample composed objects through a…

机器学习 · 计算机科学 2023-06-21 Ling Pan , Nikolay Malkin , Dinghuai Zhang , Yoshua Bengio

Recent studies suggest utilizing generative models instead of traditional auto-regressive algorithms for time series forecasting (TSF) tasks. These non-auto-regressive approaches involving different generative methods, including GAN,…

机器学习 · 计算机科学 2025-03-19 Jiangxuan Long , Zhao Song , Chiwun Yang

Many interventions, such as vaccines in clinical trials or coupons in online marketplaces, must be assigned sequentially without full knowledge of their effects. Multi-armed bandit algorithms have proven successful in such settings.…

机器学习 · 统计学 2026-05-07 Aidan Gleich , Eric Laber , Alexander Volfovsky

Generative Flow Networks (GFlowNets), a class of generative models over discrete and structured sample spaces, have been previously applied to the problem of inferring the marginal posterior distribution over the directed acyclic graph…

We introduce a framework for Thompson sampling (TS) contextual bandit algorithms, in which the algorithm's ability to quantify uncertainty and make decisions depends on the quality of a generative model that is learned offline. Instead of…

机器学习 · 计算机科学 2025-11-13 Kelly W. Zhang , Tiffany Tianhui Cai , Hongseok Namkoong , Daniel Russo

We present a novel extension of Thompson Sampling for stochastic sequential decision problems with graph feedback, even when the graph structure itself is unknown and/or changing. We provide theoretical guarantees on the Bayesian regret of…

机器学习 · 计算机科学 2017-01-17 Aristide C. Y. Tossou , Christos Dimitrakakis , Devdatt Dubhashi

The Generative Flow Network (GFlowNet) is a probabilistic framework in which an agent learns a stochastic policy and flow functions to sample objects proportionally to an unnormalized reward function. A number of recent works explored…

机器学习 · 计算机科学 2025-06-03 Haoran He , Emmanuel Bengio , Qingpeng Cai , Ling Pan

Reinforcement Learning (RL) algorithms aim to learn an optimal policy by iteratively sampling actions to learn how to maximize the total expected return, $R(x)$. GFlowNets are a special class of algorithms designed to generate diverse…

机器学习 · 计算机科学 2023-07-19 Nikhil Vemgal , Elaine Lau , Doina Precup

Generative Flow Network (GFlowNet) objectives implicitly fix an equal mixing of forward and backward policies, potentially constraining the exploration-exploitation trade-off during training. By further exploring the link between GFlowNets…

人工智能 · 计算机科学 2026-02-27 Lin Chen , Samuel Drapeau , Fanghao Shao , Xuekai Zhu , Bo Xue , Yunchong Song , Mathieu Laurière , Zhouhan Lin

Multi-task reinforcement learning and meta-reinforcement learning have been developed to quickly adapt to new tasks, but they tend to focus on tasks with higher rewards and more frequent occurrences, leading to poor performance on tasks…

机器学习 · 计算机科学 2023-06-19 Xinyuan Ji , Xu Zhang , Wei Xi , Haozhi Wang , Olga Gadyatskaya , Yinchuan Li

We consider an online decision-making problem with a reward function defined over graph-structured data. We formally formulate the problem as an instance of graph action bandit. We then propose \texttt{GNN-TS}, a Graph Neural Network (GNN)…

机器学习 · 计算机科学 2024-06-24 Shuang Wu , Arash A. Amini

In algorithm optimization in reinforcement learning, how to deal with the exploration-exploitation dilemma is particularly important. Multi-armed bandit problem can optimize the proposed solutions by changing the reward distribution to…

机器学习 · 统计学 2022-03-28 Zhendong Shi , Ercan E. Kuruoglu , Xiaoli Wei

This paper proposes a supervised training algorithm for learning stochastic resource allocation policies with generative diffusion models (GDMs). We formulate the allocation problem as the maximization of an ergodic utility function subject…

机器学习 · 计算机科学 2025-09-23 Yigit Berkay Uslu , Samar Hadou , Shirin Saeedi Bidokhti , Alejandro Ribeiro