English
Related papers

Related papers: Posterior Sampling Reinforcement Learning with Gau…

200 papers

We study a time-varying Bayesian optimization problem with bandit feedback, where the reward function belongs to a Reproducing Kernel Hilbert Space (RKHS). We approach the problem via an upper-confidence bound Gaussian Process algorithm,…

Optimization and Control · Mathematics 2025-10-27 Eliabelle Mauduit , Eloïse Berthier , Andrea Simonetto

We develop a general theory to optimize the frequentist regret for sequential learning problems, where efficient bandit and reinforcement learning algorithms can be derived from unified Bayesian principles. We propose a novel optimization…

Machine Learning · Computer Science 2024-02-12 Yunbei Xu , Assaf Zeevi

We study reinforcement learning for continuous-time Markov decision processes (MDPs) in the finite-horizon episodic setting. In contrast to discrete-time MDPs, the inter-transition times of a continuous-time MDP are exponentially…

Machine Learning · Computer Science 2023-10-04 Xuefeng Gao , Xun Yu Zhou

We study the Stochastic Shortest Path (SSP) problem with a linear mixture transition kernel, where an agent repeatedly interacts with a stochastic environment and seeks to reach certain goal state while minimizing the cumulative cost.…

Machine Learning · Computer Science 2024-02-15 Qiwei Di , Jiafan He , Dongruo Zhou , Quanquan Gu

This paper studies regret minimization with randomized value functions in reinforcement learning. In tabular finite-horizon Markov Decision Processes, we introduce a clipping variant of one classical Thompson Sampling (TS)-like algorithm,…

Machine Learning · Computer Science 2021-11-10 Priyank Agrawal , Jinglin Chen , Nan Jiang

We present an approach for satisfying state constraints in systems with nonparametric uncertainty by estimating this uncertainty with a real-time-update Gaussian process (GP) model. Notably, new data is incorporated into the model in real…

Systems and Control · Electrical Eng. & Systems 2025-05-13 Ricardo Gutierrez , Jesse B. Hoagg

Gaussian processes (GPs) are ubiquitous tools for modeling and predicting continuous processes in physical and engineering sciences. This is partly due to the fact that one may employ a Gaussian process as an interpolator while facilitating…

Statistics Theory · Mathematics 2025-12-16 D. Andrew Brown , Peter Kiessler , John Nicholson

Gaussian Processes (GPs) are powerful kernelized methods for non-parameteric regression used in many applications. However, their use is limited to a few thousand of training samples due to their cubic time complexity. In order to scale GPs…

Machine Learning · Statistics 2021-12-20 Manuel Schürch , Dario Azzimonti , Alessio Benavoli , Marco Zaffalon

We consider the problem of learning to optimize an unknown Markov decision process (MDP). We show that, if the MDP can be parameterized within some known function class, we can obtain regret bounds that scale with the dimensionality, rather…

Machine Learning · Statistics 2014-11-04 Ian Osband , Benjamin Van Roy

In this paper, we revisit the regret of undiscounted reinforcement learning in MDPs with a birth and death structure. Specifically, we consider a controlled queue with impatient jobs and the main objective is to optimize a trade-off between…

Machine Learning · Computer Science 2023-02-22 Jonatha Anselmi , Bruno Gaujal , Louis-Sébastien Rebuffi

While Bayesian-based exploration often demonstrates superior empirical performance compared to bonus-based methods in model-based reinforcement learning (RL), its theoretical understanding remains limited for model-free settings. Existing…

Machine Learning · Computer Science 2026-02-05 He Wang , Xingyu Xu , Yuejie Chi

Probabilistic classifiers are central for making informed decisions under uncertainty. Based on the maximum expected utility principle, optimal decision rules can be derived using the posterior class probabilities and misclassification…

Machine Learning · Computer Science 2025-03-25 Alexandre Perez-Lebel , Gael Varoquaux , Sanmi Koyejo , Matthieu Doutreligne , Marine Le Morvan

Probabilistic models such as Gaussian processes (GPs) are powerful tools to learn unknown dynamical systems from data for subsequent use in control design. While learning-based control has the potential to yield superior performance in…

Systems and Control · Electrical Eng. & Systems 2022-09-22 Alexander von Rohr , Matthias Neumann-Brosig , Sebastian Trimpe

We consider the problem of online combinatorial optimization under semi-bandit feedback. The goal of the learner is to sequentially select its actions from a combinatorial decision set so as to minimize its cumulative loss. We propose a…

Machine Learning · Computer Science 2013-05-14 Gergely Neu , Gábor Bartók

We introduce a novel adaptive Gaussian Process Regression (GPR) methodology for efficient construction of surrogate models for Bayesian inverse problems with expensive forward model evaluations. An adaptive design strategy focuses on…

Numerical Analysis · Mathematics 2024-05-01 Paolo Villani , Jörg Unger , Martin Weiser

Motivated by personalized healthcare and other applications involving sensitive data, we study online exploration in reinforcement learning with differential privacy (DP) constraints. Existing work on this problem established that no-regret…

Machine Learning · Computer Science 2023-02-23 Dan Qiao , Yu-Xiang Wang

This paper studies model-based reinforcement learning (RL) for regret minimization. We focus on finite-horizon episodic RL where the transition model $P$ belongs to a known family of models $\mathcal{P}$, a special case of which is when…

Machine Learning · Computer Science 2020-06-02 Alex Ayoub , Zeyu Jia , Csaba Szepesvari , Mengdi Wang , Lin F. Yang

We present an implementation of model-based online reinforcement learning (RL) for continuous domains with deterministic transitions that is specifically designed to achieve low sample complexity. To achieve low sample complexity, since the…

Artificial Intelligence · Computer Science 2012-02-01 Tobias Jung , Peter Stone

This paper is motivated by recent research in the $d$-dimensional stochastic linear bandit literature, which has revealed an unsettling discrepancy: algorithms like Thompson sampling and Greedy demonstrate promising empirical performance,…

Machine Learning · Computer Science 2025-05-20 Yuwei Luo , Mohsen Bayati

Bayesian optimization (BO) is a widely used iterative algorithm for optimizing black-box functions. Each iteration requires maximizing an acquisition function, such as the upper confidence bound (UCB) or a sample path from the Gaussian…

Machine Learning · Statistics 2025-06-16 Hwanwoo Kim , Chong Liu , Yuxin Chen
‹ Prev 1 8 9 10 Next ›