English
Related papers

Related papers: Sample-Mean Anchored Thompson Sampling for Offline…

200 papers

A long-standing problem in online reinforcement learning (RL) is of ensuring sample efficiency, which stems from an inability to explore environments efficiently. Most attempts at efficient exploration tackle this problem in a setting where…

Machine Learning · Computer Science 2025-07-08 Aman Mehra , Alexandre Capone , Jeff Schneider

We consider a non-stationary two-armed bandit framework and propose a change-detection based Thompson sampling (TS) algorithm, named TS with change-detection (TS-CD), to keep track of the dynamic environment. The non-stationarity is modeled…

Machine Learning · Computer Science 2020-09-09 Gourab Ghatak

Contextual bandits constitute a classical framework for decision-making under uncertainty. In this setting, the goal is to learn the arms of highest reward subject to contextual information, while the unknown reward parameters of each arm…

Machine Learning · Statistics 2024-02-19 Hongju Park , Mohamad Kazem Shirani Faradonbeh

In this paper, we introduce and analyze a variant of the Thompson sampling (TS) algorithm for contextual bandits. At each round, traditional TS requires samples from the current posterior distribution, which is usually intractable. To…

Machine Learning · Statistics 2024-07-23 Pierre Clavier , Tom Huix , Alain Durmus

Temporal credit assignment in reinforcement learning is challenging due to delayed and stochastic outcomes. Monte Carlo targets can bridge long delays between action and consequence but lead to high-variance targets due to stochasticity.…

Machine Learning · Computer Science 2024-06-05 Aditya A. Ramesh , Kenny Young , Louis Kirsch , Jürgen Schmidhuber

Offline reinforcement learning (RL) aims to learn a policy that maximizes the expected return using a given static dataset of transitions. However, offline RL faces the distribution shift problem. The policy constraint offline RL method is…

Machine Learning · Computer Science 2025-12-24 Yuanhao Chen , Qi Liu , Pengbin Chen , Zhongjian Qiao , Yanjie Li

We present a novel approach for test-time adaptation via online self-training, consisting of two components. First, we introduce a statistical framework that detects distribution shifts in the classifier's entropy values obtained on a…

Machine Learning · Computer Science 2025-01-07 Yarin Bar , Shalev Shaer , Yaniv Romano

Conventional semi-supervised contrastive learning methods assign pseudo-labels only to samples whose highest predicted class probability exceeds a predefined threshold, and then perform supervised contrastive learning using those selected…

Machine Learning · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

Thompson sampling (TS) is one of the most popular exploration techniques in reinforcement learning (RL). However, most TS algorithms with theoretical guarantees are difficult to implement and not generalizable to Deep RL. While the emerging…

Machine Learning · Computer Science 2024-06-19 Haque Ishfaq , Yixin Tan , Yu Yang , Qingfeng Lan , Jianfeng Lu , A. Rupam Mahmood , Doina Precup , Pan Xu

Recent advances in contextual bandit optimization and reinforcement learning have garnered interest in applying these methods to real-world sequential decision making problems. Real-world applications frequently have constraints with…

Machine Learning · Computer Science 2019-11-05 Samuel Daulton , Shaun Singh , Vashist Avadhanula , Drew Dimmery , Eytan Bakshy

We study the process-level dynamics of Thompson sampling and related sampling-based bandit algorithms in the ``small gap'' regime, where the gaps between the arm means are of order $\sqrt{\gamma}$ or smaller and the time horizon is of order…

Machine Learning · Computer Science 2026-04-23 Lin Fan , Peter W. Glynn

We consider a finite-armed structured bandit problem in which mean rewards of different arms are known functions of a common hidden parameter $\theta^*$. Since we do not place any restrictions of these functions, the problem setting…

Machine Learning · Statistics 2021-02-04 Samarth Gupta , Shreyas Chaudhari , Subhojyoti Mukherjee , Gauri Joshi , Osman Yağan

A latent bandit problem is one in which the learning agent knows the arm reward distributions conditioned on an unknown discrete latent state. The primary goal of the agent is to identify the latent state, after which it can act optimally.…

Machine Learning · Computer Science 2020-06-17 Joey Hong , Branislav Kveton , Manzil Zaheer , Yinlam Chow , Amr Ahmed , Craig Boutilier

We study a decentralized cooperative multi-agent multi-armed bandit problem with $K$ arms and $N$ agents connected over a network. In our model, each arm's reward distribution is same for all agents, and rewards are drawn independently…

Machine Learning · Statistics 2020-10-29 Anusha Lalitha , Andrea Goldsmith

We consider the classic online learning and stochastic multi-armed bandit (MAB) problems, when at each step, the online policy can probe and find out which of a small number ($k$) of choices has better reward (or loss) before making its…

Data Structures and Algorithms · Computer Science 2022-11-08 Aditya Bhaskara , Sreenivas Gollapudi , Sungjin Im , Kostas Kollias , Kamesh Munagala

Adaptive importance sampling (AIS) algorithms are widely used to approximate expectations with respect to complicated target probability distributions. When the target has heavy tails, existing AIS algorithms can provide inconsistent…

Computation · Statistics 2023-10-26 Thomas Guilmeau , Nicola Branchini , Emilie Chouzenoux , Víctor Elvira

In this paper, we aim to improve the performance of a deep learning model towards image classification tasks, proposing a novel anchor-based training methodology, named \textit{Online Anchor-based Training} (OAT). The OAT method, guided by…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Maria Tzelepi , Vasileios Mezaris

Thompson sampling (TS) is a simple, effective stochastic policy in Bayesian decision making. It samples the posterior belief about the reward profile and optimizes the sample to obtain a candidate decision. In continuous optimization, the…

Machine Learning · Computer Science 2024-10-11 Taiwo A. Adebiyi , Bach Do , Ruda Zhang

Imitation from observation is the framework of learning tasks by observing demonstrated state-only trajectories. Recently, adversarial approaches have achieved significant performance improvements over other methods for imitating complex…

Machine Learning · Computer Science 2019-06-19 Faraz Torabi , Sean Geiger , Garrett Warnell , Peter Stone

Thompson sampling is one of the earliest randomized algorithms for multi-armed bandits (MAB). In this paper, we extend the Thompson sampling to Budgeted MAB, where there is random cost for pulling an arm and the total cost is constrained by…

Machine Learning · Computer Science 2015-05-04 Yingce Xia , Haifang Li , Tao Qin , Nenghai Yu , Tie-Yan Liu