English
Related papers

Related papers: Gaussian Process Uniform Error Bounds with Unknown…

200 papers

Model Predictive Control evolved as the state of the art paradigm for safety critical control tasks. Control-as-Inference approaches thereof model the constrained optimization problem as a probabilistic inference problem. The constraints…

Optimization and Control · Mathematics 2025-11-21 Jörn Tebbe , Andreas Besginow , Markus Lange-Hegermann

Post-hoc explanation methods have become a critical tool for understanding black-box classifiers in high-stakes applications. However, high-performing classifiers are often highly nonlinear and can exhibit complex behavior around the…

Machine Learning · Computer Science 2024-03-05 Davin Hill , Aria Masoomi , Max Torop , Sandesh Ghimire , Jennifer Dy

Many applications require a learner to make sequential decisions given uncertainty regarding both the system's payoff function and safety constraints. In safety-critical systems, it is paramount that the learner's actions do not violate the…

Machine Learning · Computer Science 2020-05-06 Sanae Amani , Mahnoosh Alizadeh , Christos Thrampoulidis

We investigate the capabilities and limitations of Gaussian process models by jointly exploring three complementary directions: (i) scalable and statistically efficient inference; (ii) flexible kernels; and (iii) objective functions for…

Machine Learning · Statistics 2017-03-07 Karl Krauth , Edwin V. Bonilla , Kurt Cutajar , Maurizio Filippone

Identifying dynamical system (DS) is a vital task in science and engineering. Traditional methods require numerous calls to the DS solver, rendering likelihood-based or least-squares inference frameworks impractical. For efficient parameter…

Computation · Statistics 2024-09-19 Ying Zhou , Jinglai Li , Xiang Zhou , Hongqiao Wang

Large-scale Gaussian process inference has long faced practical challenges due to time and space complexity that is superlinear in dataset size. While sparse variational Gaussian process models are capable of learning from large-scale data,…

Machine Learning · Statistics 2018-01-23 Ching-An Cheng , Byron Boots

Gaussian process hyperparameter optimization requires linear solves with, and log-determinants of, large kernel matrices. Iterative numerical techniques are becoming popular to scale to larger datasets, relying on the conjugate gradient…

Machine Learning · Computer Science 2022-06-22 Jonathan Wenger , Geoff Pleiss , Philipp Hennig , John P. Cunningham , Jacob R. Gardner

Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs) are popular tools for enforcing safety and stability of a controlled system, respectively. They are commonly utilized to build constraints that can be incorporated in a…

Systems and Control · Electrical Eng. & Systems 2021-10-05 Fernando Castañeda , Jason J. Choi , Bike Zhang , Claire J. Tomlin , Koushil Sreenath

Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process…

Machine Learning · Computer Science 2015-02-19 Rafael Boloix-Tortosa , F. Javier Payán-Somet , Eva Arias-de-Reyna , Juan José Murillo-Fuentes

Recently nonparametric functional model with functional responses has been proposed within the functional reproducing kernel Hilbert spaces (fRKHS) framework. Motivated by its superior performance and also its limitations, we propose a…

Methodology · Statistics 2010-08-11 Heng Lian

Gaussian Process based Bayesian Optimization is a widely applied algorithm to learn and optimize under uncertainty, well-known for its sample efficiency. However, recently -- and more frequently -- research studies have empirically…

Machine Learning · Statistics 2025-05-20 Antonio Candelieri , Andrea Ponti , Francesco Archetti

Bayesian optimization usually assumes that a Bayesian prior is given. However, the strong theoretical guarantees in Bayesian optimization are often regrettably compromised in practice because of unknown parameters in the prior. In this…

Machine Learning · Computer Science 2018-11-26 Zi Wang , Beomjoon Kim , Leslie Pack Kaelbling

Expensive ultrasonic anemometers are usually required to measure wind speed accurately. The aim of this work is to overcome the loss of accuracy of a low cost hot-wire anemometer caused by the changes of air temperature, by means of a…

Kriging based on Gaussian random fields is widely used in reconstructing unknown functions. The kriging method has pointwise predictive distributions which are computationally simple. However, in many applications one would like to predict…

Statistics Theory · Mathematics 2019-03-20 Wenjia Wang , Rui Tuo , C. F. Jeff Wu

Uncertainty quantification plays a key role in the development of autonomous systems, decision-making, and tracking over wireless sensor networks (WSNs). However, there is a need of providing uncertainty confidence bounds, especially for…

Machine Learning · Statistics 2024-09-13 Xingchi Liu , Lyudmila Mihaylova , Jemin George , Tien Pham

Gaussian process upper confidence bound (GP-UCB) is a theoretically promising approach for black-box optimization; however, the confidence parameter $\beta$ is considerably large in the theorem and chosen heuristically in practice. Then,…

Machine Learning · Computer Science 2023-06-13 Shion Takeno , Yu Inatsu , Masayuki Karasuyama

We study the problem of safe learning and exploration in sequential control problems. The goal is to safely collect data samples from operating in an environment, in order to learn to achieve a challenging control goal (e.g., an agile…

Machine Learning · Computer Science 2020-06-30 Anqi Liu , Guanya Shi , Soon-Jo Chung , Anima Anandkumar , Yisong Yue

We propose a probabilistic enhancement of standard kernel Support Vector Machines for binary classification, in order to address the case when, along with given data sets, a description of uncertainty (e.g., error bounds) may be available…

Machine Learning · Computer Science 2020-03-19 Yongxin Chen , Tryphon T. Georgiou , Allen R. Tannenbaum

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…

Complex-valued Gaussian processes are used in Bayesian frequency-domain system identification as prior models for regression. If each realization of such a process were an $H_\infty$ function with probability one, then the same model could…

Systems and Control · Electrical Eng. & Systems 2022-11-30 Alex Devonport , Peter Seiler , Murat Arcak