English
Related papers

Related papers: Zero-Order Optimization for Gaussian Process-based…

200 papers

This paper proposes a receding horizon active learning and control problem for dynamical systems in which Gaussian Processes (GPs) are utilized to model the system dynamics. The active learning objective in the optimization problem is…

Systems and Control · Electrical Eng. & Systems 2021-05-13 Viet-Anh Le , Truong X. Nghiem

Autonomous racing control is a challenging research problem as vehicles are pushed to their limits of handling to achieve an optimal lap time; therefore, vehicles exhibit highly nonlinear and complex dynamics. Difficult-to-model effects,…

Robotics · Computer Science 2023-06-28 Shaoshu Su , Ce Hao , Catherine Weaver , Chen Tang , Wei Zhan , Masayoshi Tomizuka

Gaussian process (GP) models are widely used to analyze spatially referenced data and to predict values at locations without observations. In contrast to many algorithmic procedures, GP models are based on a statistical framework, which…

Computation · Statistics 2020-01-01 Florian Gerber , Douglas W. Nychka

Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of…

Machine Learning · Statistics 2012-08-30 Jasper Snoek , Hugo Larochelle , Ryan P. Adams

Gaussian processes (GP) provide a prior over functions and allow finding complex regularities in data. Gaussian processes are successfully used for classification/regression problems and dimensionality reduction. In this work we consider…

Machine Learning · Computer Science 2016-11-21 Pavel Izmailov , Dmitry Kropotov

Gaussian processes (GPs) with derivatives are useful in many applications, including Bayesian optimization, implicit surface reconstruction, and terrain reconstruction. Fitting a GP to function values and derivatives at $n$ points in $d$…

Machine Learning · Computer Science 2018-10-30 David Eriksson , Kun Dong , Eric Hans Lee , David Bindel , Andrew Gordon Wilson

Bayesian hyperparameter optimization relies heavily on Gaussian Process (GP) surrogates, due to robust distributional posteriors and strong performance on limited training samples. GPs however underperform in categorical hyperparameter…

Machine Learning · Computer Science 2025-09-23 Riccardo Doyle

This paper presents an adaptive online learning framework for systems with uncertain parameters to ensure safety-critical control in non-stationary environments. Our approach consists of two phases. The initial phase is centered on a novel…

Machine Learning · Computer Science 2024-03-06 Yu Zhang , Long Wen , Xiangtong Yao , Zhenshan Bing , Linghuan Kong , Wei He , Alois Knoll

We introduce new Gaussian Process (GP) high-order approximations to linear operations that are frequently used in various numerical methods. Our method employs the kernel-based GP regression modeling, a non-parametric Bayesian approach to…

Computational Physics · Physics 2025-06-09 Christopher DeGrendele , Dongwook Lee

The Gaussian process (GP) is a Bayesian nonparametric paradigm that is widely adopted for uncertainty quantification (UQ) in a number of safety-critical applications, including robotics, healthcare, as well as surveillance. The consistency…

Machine Learning · Computer Science 2024-10-10 Jinwen Xu , Qin Lu , Georgios B. Giannakis

The thesis focuses on developing a data-driven algorithm, based on machine learning, to solve the stochastic alternating current (AC) chance-constrained (CC) Optimal Power Flow (OPF) problem. Although the AC CC-OPF problem has been…

Machine Learning · Computer Science 2024-02-20 Mile Mitrovic

Credible forecasting and representation learning of dynamical systems are of ever-increasing importance for reliable decision-making. To that end, we propose a family of Gaussian processes (GP) for dynamical systems with linear…

Machine Learning · Computer Science 2025-02-11 Petar Bevanda , Max Beier , Armin Lederer , Alexandre Capone , Stefan Sosnowski , Sandra Hirche

As a non-parametric Bayesian model which produces informative predictive distribution, Gaussian process (GP) has been widely used in various fields, like regression, classification and optimization. The cubic complexity of standard GP…

Machine Learning · Statistics 2018-11-06 Haitao Liu , Jianfei Cai , Yew-Soon Ong , Yi Wang

Nonlinear model predictive control (NMPC) is an efficient approach for the control of nonlinear multivariable dynamic systems with constraints, which however requires an accurate plant model. Plant models can often be determined from first…

Systems and Control · Electrical Eng. & Systems 2021-08-17 E. Bradford , L. Imsland , M. Reble , E. A. del Rio-Chanona

Automatic forecasting is the task of receiving a time series and returning a forecast for the next time steps without any human intervention. Gaussian Processes (GPs) are a powerful tool for modeling time series, but so far there are no…

Machine Learning · Statistics 2023-04-27 Giorgio Corani , Alessio Benavoli , Marco Zaffalon

Model Predictive Path Integral (MPPI) control is a sampling-based optimization method that has recently attracted attention, particularly in the robotics and reinforcement learning communities. MPPI has been widely applied as a…

Systems and Control · Electrical Eng. & Systems 2026-02-26 Hannes Homburger , Katrin Baumgärtner , Moritz Diehl , Johannes Reuter

We study preferential Bayesian optimization (BO) where reliable feedback is limited to pairwise comparison called duels. An important challenge in preferential BO, which uses the preferential Gaussian process (GP) model to represent…

Machine Learning · Computer Science 2023-06-13 Shion Takeno , Masahiro Nomura , Masayuki Karasuyama

This paper presents a real-time capable algorithm for the learning of Gaussian Processes (GP) for submodels. It extends an existing recursive Gaussian Process (RGP) algorithm which requires a measurable output. In many applications,…

Systems and Control · Electrical Eng. & Systems 2025-11-24 Ricus Husmann , Sven Weishaupt , Harald Aschemann

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

Gaussian Processes (GPs) are expressive models for capturing signal statistics and expressing prediction uncertainty. As a result, the robotics community has gathered interest in leveraging these methods for inference, planning, and…

Robotics · Computer Science 2023-08-29 Francesco Crocetti , Jeffrey Mao , Alessandro Saviolo , Gabriele Costante , Giuseppe Loianno