English
Related papers

Related papers: Randomized Gaussian Process Upper Confidence Bound…

200 papers

Due to the increasing complexity of technical systems, accurate first principle models can often not be obtained. Supervised machine learning can mitigate this issue by inferring models from measurement data. Gaussian process regression is…

Systems and Control · Electrical Eng. & Systems 2023-07-11 Armin Lederer , Jonas Umlauft , Sandra Hirche

We motivate and analyse a new Tree Search algorithm, GPTS, based on recent theoretical advances in the use of Gaussian Processes for Bandit problems. We consider tree paths as arms and we assume the target/reward function is drawn from a GP…

Machine Learning · Computer Science 2011-01-18 Louis Dorard , John Shawe-Taylor

Motivated by applications of bandit algorithms in education, we consider a stochastic multi-armed bandit problem with $\varepsilon$-contaminated rewards. We allow an adversary to give arbitrary unbounded contaminated rewards with full…

Machine Learning · Statistics 2020-06-19 Laura Niss , Ambuj Tewari

We present a planning framework for minimising the deterministic worst-case error in sparse Gaussian process (GP) regression. We first derive a universal worst-case error bound for sparse GP regression with bounded noise using interpolation…

Robotics · Computer Science 2023-01-25 Jennifer Wakulicz , Ki Myung Brian Lee , Chanyeol Yoo , Teresa Vidal-Calleja , Robert Fitch

The general sequential decision-making problem, which includes Markov decision processes (MDPs) and partially observable MDPs (POMDPs) as special cases, aims at maximizing a cumulative reward by making a sequence of decisions based on a…

Machine Learning · Computer Science 2024-02-07 Ruiquan Huang , Yingbin Liang , Jing Yang

Bayesian optimization (BO) is a powerful paradigm for optimizing expensive black-box functions. Traditional BO methods typically rely on separate hand-crafted acquisition functions and surrogate models for the underlying function, and often…

Machine Learning · Computer Science 2025-07-10 Fengxue Zhang , Yuxin Chen

This paper presents a new approach to a robust Gaussian process (GP) regression. Most existing approaches replace an outlier-prone Gaussian likelihood with a non-Gaussian likelihood induced from a heavy tail distribution, such as the…

Machine Learning · Computer Science 2020-01-15 Chiwoo Park , David J. Borth , Nicholas S. Wilson , Chad N. Hunter , Fritz J. Friedersdorf

Gaussian process regression (GPR) is a popular nonparametric Bayesian method that provides predictive uncertainty estimates and is widely used in safety-critical applications. While prior research has introduced various uncertainty bounds,…

Machine Learning · Computer Science 2025-12-05 Junyi Liu , Stanley Kok

Folding uncertainty in theoretical models into Bayesian parameter estimation is necessary in order to make reliable inferences. A general means of achieving this is by marginalizing over model uncertainty using a prior distribution…

General Relativity and Quantum Cosmology · Physics 2016-03-04 Christopher J. Moore , Christopher P. L. Berry , Alvin J. K. Chua , Jonathan R. Gair

The multi-armed bandit (MAB) problem is a foundational framework in sequential decision-making under uncertainty, extensively studied for its applications in areas such as clinical trials, online advertising, and resource allocation.…

Machine Learning · Computer Science 2024-10-28 Ali Baheri

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson

We consider the problem of global optimization with noisy zeroth order oracles - a well-motivated problem useful for various applications ranging from hyper-parameter tuning for deep learning to new material design. Existing work relies on…

Machine Learning · Computer Science 2023-07-21 Chong Liu , Yu-Xiang Wang

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

Machine Learning · Statistics 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

We consider the upper confidence bound strategy for Gaussian multi-armed bandits with known control horizon sizes $N$ and build its limiting description with a system of stochastic differential equations and ordinary differential equations.…

Machine Learning · Computer Science 2023-05-12 Sergey Garbar

Bayesian optimization is a class of global optimization techniques. In Bayesian optimization, the underlying objective function is modeled as a realization of a Gaussian process. Although the Gaussian process assumption implies a random…

Statistics Theory · Mathematics 2023-05-08 Rui Tuo , Wenjia Wang

We consider chance constrained optimization where it is sought to optimize a function while complying with constraints, both of which are affected by uncertainties. The high computational cost of realistic simulations strongly limits the…

Optimization and Control · Mathematics 2022-04-18 Julien Pelamatti , Rodolphe Le Riche , Céline Helbert , Christophette Blanchet-Scalliet

Non-conjugate Gaussian processes (NCGPs) define a flexible probabilistic framework to model categorical, ordinal and continuous data, and are widely used in practice. However, exact inference in NCGPs is prohibitively expensive for large…

Machine Learning · Computer Science 2025-04-18 Lukas Tatzel , Jonathan Wenger , Frank Schneider , Philipp Hennig

Although real-world decision-making problems can often be encoded as causal multi-armed bandits (CMABs) at different levels of abstraction, a general methodology exploiting the information and computational advantages of each abstraction…

Machine Learning · Computer Science 2025-09-05 Joel Dyer , Nicholas Bishop , Anisoara Calinescu , Michael Wooldridge , Fabio Massimo Zennaro

Guided-diffusion black-box optimization (BO) has shown strong empirical performance on structured design problems such as molecules and crystals, but its regret behavior remains poorly understood. Existing BO regret analyses typically rely…

Machine Learning · Statistics 2026-05-12 Masaki Adachi , Anita Yang , Yakun Wang , Song Liu

We investigate uncertainties in the estimation of the Hubble constant ($H_0$) arising from Gaussian Process (GP) reconstruction, demonstrating that the choice of kernel introduces systematic variations comparable to those arising from…

Cosmology and Nongalactic Astrophysics · Physics 2025-10-07 Ruchika , Purba Mukherjee , Arianna Favale
‹ Prev 1 8 9 10 Next ›