English
Related papers

Related papers: Regenerative Particle Thompson Sampling

200 papers

Gaussian process (GP) bandits provide a powerful framework for performing blackbox optimization of unknown functions. The characteristics of the unknown function depend heavily on the assumed GP prior. Most work in the literature assume…

Machine Learning · Computer Science 2026-03-13 Jack Sandberg , Morteza Haghir Chehreghani

Stochastic Rank-One Bandits (Katarya et al, (2017a,b)) are a simple framework for regret minimization problems over rank-one matrices of arms. The initially proposed algorithms are proved to have logarithmic regret, but do not match the…

Machine Learning · Statistics 2019-12-09 Cindy Trinh , Emilie Kaufmann , Claire Vernade , Richard Combes

The Bouncy Particle Sampler (BPS) is a Monte Carlo Markov Chain algorithm to sample from a target density known up to a multiplicative constant. This method is based on a kinetic piecewise deterministic Markov process for which the target…

Probability · Mathematics 2019-11-18 Alain Durmus , Arnaud Guillin , Pierre Monmarché

We consider the exploration-exploitation tradeoff in linear quadratic (LQ) control problems, where the state dynamics is linear and the cost function is quadratic in states and controls. We analyze the regret of Thompson sampling (TS)…

Machine Learning · Statistics 2017-03-28 Marc Abeille , Alessandro Lazaric

Ensemble sampling serves as a practical approximation to Thompson sampling when maintaining an exact posterior distribution over model parameters is computationally intractable. In this paper, we establish a regret bound that ensures…

Machine Learning · Computer Science 2023-03-02 Chao Qin , Zheng Wen , Xiuyuan Lu , Benjamin Van Roy

Thompson sampling for multi-armed bandit problems is known to enjoy favorable performance in both theory and practice. However, it suffers from a significant limitation computationally, arising from the need for samples from posterior…

Machine Learning · Computer Science 2020-06-19 Eric Mazumdar , Aldo Pacchiano , Yi-an Ma , Peter L. Bartlett , Michael I. Jordan

We investigate experiments that are designed to select a treatment arm for population deployment. Multi-armed bandit algorithms can enhance efficiency by dynamically allocating measurement effort towards higher performing arms based on…

Machine Learning · Computer Science 2023-08-29 Chao Qin , Daniel Russo

We study the process-level dynamics of Thompson sampling and related sampling-based bandit algorithms in the ``small gap'' regime, where the gaps between the arm means are of order $\sqrt{\gamma}$ or smaller and the time horizon is of order…

Machine Learning · Computer Science 2026-04-23 Lin Fan , Peter W. Glynn

Wireless communication systems operate in complex time-varying environments. Therefore, selecting the optimal configuration parameters in these systems is a challenging problem. For wireless links, \emph{rate selection} is used to select…

Machine Learning · Computer Science 2020-04-21 Vidit Saxena , Joseph E. Gonzalez , Ion Stoica , Hugo Tullberg , Joakim Jaldén

We develop an implementable stochastic proximal point (SPP) method for a class of weakly convex, composite optimization problems. The proposed stochastic proximal point algorithm incorporates a variance reduction mechanism and the resulting…

Optimization and Control · Mathematics 2024-03-27 Andre Milzarek , Fabian Schaipp , Michael Ulbrich

Bayesian optimization (BO), which uses a Gaussian process (GP) as a surrogate to model its objective function, is popular for black-box optimization. However, due to the limitations of GPs, BO underperforms in some problems such as those…

Machine Learning · Computer Science 2022-10-14 Zhongxiang Dai , Yao Shu , Bryan Kian Hsiang Low , Patrick Jaillet

The stochastic multi-arm bandit problem has been extensively studied under standard assumptions on the arm's distribution (e.g bounded with known support, exponential family, etc). These assumptions are suitable for many real-world problems…

Machine Learning · Statistics 2021-11-19 Dorian Baudry , Patrick Saux , Odalric-Ambrym Maillard

Meta-, multi-task, and federated learning can be all viewed as solving similar tasks, drawn from a distribution that reflects task similarities. We provide a unified view of all these problems, as learning to act in a hierarchical Bayesian…

Machine Learning · Computer Science 2022-03-08 Joey Hong , Branislav Kveton , Manzil Zaheer , Mohammad Ghavamzadeh

Contextual multi-armed bandits are classical models in reinforcement learning for sequential decision-making associated with individual information. A widely-used policy for bandits is Thompson Sampling, where samples from a data-driven…

Machine Learning · Statistics 2021-11-30 Hongju Park , Mohamad Kazem Shirani Faradonbeh

The problem of two-sided matching markets has a wide range of real-world applications and has been extensively studied in the literature. A line of recent works have focused on the problem setting where the preferences of one-side market…

Machine Learning · Computer Science 2022-05-03 Fang Kong , Junming Yin , Shuai Li

Recent advances in contextual bandit optimization and reinforcement learning have garnered interest in applying these methods to real-world sequential decision making problems. Real-world applications frequently have constraints with…

Machine Learning · Computer Science 2019-11-05 Samuel Daulton , Shaun Singh , Vashist Avadhanula , Drew Dimmery , Eytan Bakshy

Randomized controlled trials typically assume that prognostic covariates are known and available at no cost. In practice, obtaining high-dimensional pretreatment data is costly, forcing a trade-off between covariate-adaptive precision and a…

Machine Learning · Statistics 2026-05-08 Kateryna Husar , Alexander Volfovsky

During the last decade, sampling-based path planning algorithms, such as Probabilistic RoadMaps (PRM) and Rapidly-exploring Random Trees (RRT), have been shown to work well in practice and possess theoretical guarantees such as…

Robotics · Computer Science 2011-05-09 Sertac Karaman , Emilio Frazzoli

We study the regret of Thompson sampling (TS) algorithms for exponential family bandits, where the reward distribution is from a one-dimensional exponential family, which covers many common reward distributions including Bernoulli,…

Machine Learning · Statistics 2022-06-09 Tianyuan Jin , Pan Xu , Xiaokui Xiao , Anima Anandkumar

Restless bandit problems assume time-varying reward distributions of the arms, which adds flexibility to the model but makes the analysis more challenging. We study learning algorithms over the unknown reward distributions and prove a…

Machine Learning · Computer Science 2019-10-15 Young Hun Jung , Marc Abeille , Ambuj Tewari