English
Related papers

Related papers: A PDE-based Adaptive Kernel Method for Solving Opt…

200 papers

Bayesian filtering approximates the true underlying behavior of a time-varying system by inverting an explicit generative model to convert noisy measurements into state estimates. This process typically requires either storage, inversion,…

Machine Learning · Computer Science 2023-11-20 Gianluca M. Bencomo , Jake C. Snell , Thomas L. Griffiths

Bayesian model updating based on Gaussian Process (GP) models has received attention in recent years, which incorporates kernel-based GPs to provide enhanced fidelity response predictions. Although most kernel functions provide high fitting…

We consider a random dynamical system on $\mathbb{R}^d$, whose dynamics is defined by a stochastic differential equation. The annealed transfer operator associated with such systems is a kernel operator. Given a set of feasible…

Dynamical Systems · Mathematics 2025-06-02 Gianmarco del Sarto , Stefano Galatolo , Sakshi Jain

We consider stochastic systems of interacting particles or agents, with dynamics determined by an interaction kernel which only depends on pairwise distances. We study the problem of inferring this interaction kernel from observations of…

Statistics Theory · Mathematics 2020-07-31 Fei Lu , Mauro Maggioni , Sui Tang

We present a probabilistic framework for both (i) determining the initial settings of kernel adaptive filters (KAFs) and (ii) constructing fully-adaptive KAFs whereby in addition to weights and dictionaries, kernel parameters are learnt…

Machine Learning · Statistics 2017-07-21 Iván Castro , Cristóbal Silva , Felipe Tobar

This article presents a three-step framework for learning and solving partial differential equations (PDEs) using kernel methods. Given a training set consisting of pairs of noisy PDE solutions and source/boundary terms on a mesh, kernel…

Machine Learning · Statistics 2023-04-03 Da Long , Nicole Mrvaljevic , Shandian Zhe , Bamdad Hosseini

Achieving ultimate bounds in estimation processes is the main objective of quantum metrology. In this context, several problems require measurement of multiple parameters by employing only a limited amount of resources. To this end,…

In this paper we develop a dynamic form of Bayesian optimization for machine learning models with the goal of rapidly finding good hyperparameter settings. Our method uses the partial information gained during the training of a machine…

Machine Learning · Statistics 2014-06-17 Kevin Swersky , Jasper Snoek , Ryan Prescott Adams

The present paper proposes generalized Gaussian kernel adaptive filtering, where the kernel parameters are adaptive and data-driven. The Gaussian kernel is parametrized by a center vector and a symmetric positive definite (SPD) precision…

Machine Learning · Computer Science 2021-05-20 Tomoya Wada , Kosuke Fukumori , Toshihisa Tanaka , Simone Fiori

The optimal selection of experimental conditions is essential to maximizing the value of data for inference and prediction, particularly in situations where experiments are time-consuming and expensive to conduct. We propose a general…

Machine Learning · Statistics 2012-12-04 Xun Huan , Youssef M. Marzouk

This paper considers the filtering problem which consists in reconstructing the state of a dynamical system with partial observations coming from sensor measurements, and the knowledge that the dynamics are governed by a physical PDE model…

Numerical Analysis · Mathematics 2024-02-01 Joubine Aghili , Joy Zialesi Atokple , Marie Billaud-Friess , Guillaume Garnier , Olga Mula , Norbert Tognon

Controller tuning and parameter optimization are crucial in system design to improve closed-loop system performance. Bayesian optimization has been established as an efficient model-free controller tuning and adaptation method. However,…

Systems and Control · Electrical Eng. & Systems 2024-04-24 Christopher König , Raamadaas Krishnadas , Efe C. Balta , Alisa Rupenyan

Large-scale agent systems have foreseeable applications in the near future. Estimating their macroscopic density is critical for many density-based optimization and control tasks, such as sensor deployment and city traffic scheduling. In…

Systems and Control · Electrical Eng. & Systems 2020-07-06 Tongjia Zheng , Qing Han , Hai Lin

Stochastic gradient descent algorithms for training linear and kernel predictors are gaining more and more importance, thanks to their scalability. While various methods have been proposed to speed up their convergence, the model selection…

Machine Learning · Computer Science 2014-06-17 Francesco Orabona

We propose a kernel mixture of polynomials prior for Bayesian nonparametric regression. The regression function is modeled by local averages of polynomials with kernel mixture weights. We obtain the minimax-optimal rate of contraction of…

Statistics Theory · Mathematics 2018-09-17 Fangzheng Xie , Yanxun Xu

Control system optimization has long been a fundamental challenge in robotics. While recent advancements have led to the development of control algorithms that leverage learning-based approaches, such as SafeOpt, to optimize single feedback…

Robotics · Computer Science 2024-11-13 Lihao Zheng , Hongxuan Wang , Xiaocong Li , Jun Ma , Prahlad Vadakkepat

Data assimilation (DA) provides a general framework for estimation in dynamical systems based on the concepts of Bayesian inference. This constitutes a common basis for the different linear and nonlinear filtering and smoothing techniques…

Optimization and Control · Mathematics 2023-03-08 Tarek Diaa-Eldeen , Marcus Krogh Nielsen , Carl Fredrik Berg , Morten Hovd , John Bagterp Jørgensen

We develop and analyze a method for stochastic simulation optimization based on Gaussian process models within a trust-region framework. We focus on settings where the variance of the objective function is large, making accurate estimation…

Optimization and Control · Mathematics 2026-03-10 Mickael Binois , Jeffrey Larson

We consider the utilization of a computational model to guide the optimal acquisition of experimental data to inform the stochastic description of model input parameters. Our formulation is based on the recently developed consistent…

Computation · Statistics 2021-05-04 Scott N. Walsh , Tim M. Wildey , John D. Jakeman

The efficiency of Bayesian optimization (BO) relies heavily on the choice of the Gaussian process (GP) kernel, which plays a central role in balancing exploration and exploitation under limited evaluation budgets. Traditional BO methods…

Machine Learning · Computer Science 2025-09-24 Richard Cornelius Suwandi , Feng Yin , Juntao Wang , Renjie Li , Tsung-Hui Chang , Sergios Theodoridis