English
Related papers

Related papers: A PDE-based Adaptive Kernel Method for Solving Opt…

200 papers

We present a general nonlinear Bayesian filter for high-dimensional state estimation using the theory of reproducing kernel Hilbert space (RKHS). Applying kernel method and the representer theorem to perform linear quadratic estimation in a…

Signal Processing · Electrical Eng. & Systems 2019-11-26 Kan Li , Jose C. Principe

We propose a novel deterministic sampling method to approximate a target distribution $\rho^*$ by minimizing the kernel discrepancy, also known as the Maximum Mean Discrepancy (MMD). By employing the general \emph{energetic variational…

Machine Learning · Statistics 2025-03-12 Yindong Chen , Yiwei Wang , Lulu Kang , Chun Liu

Particle flow filters solve Bayesian inference problems by smoothly transforming a set of particles into samples from the posterior distribution. Particles move in state space under the flow of an McKean-Vlasov-Ito process. This work…

Optimization and Control · Mathematics 2025-05-02 Amit N Subrahmanya , Andrey A Popov , Adrian Sandu

Efficiently solving the Fokker-Planck equation (FPE) is crucial for understanding the probabilistic evolution of stochastic particles in dynamical systems, however, analytical solutions or density functions are only attainable in specific…

Computational Physics · Physics 2025-03-13 Xiaolong Wang , Jing Feng , Gege Wang , Tong Li , Yong Xu

In this paper an optimal control problem for a large system of interacting agents is considered using a kinetic perspective. As a prototype model we analyze a microscopic model of opinion formation under constraints. For this problem a…

Optimization and Control · Mathematics 2014-01-31 Giacomo Albi , Michael Herty , Lorenzo Pareschi

A Bayesian filtering algorithm is developed for a class of state-space systems that can be modelled via Gaussian mixtures. In general, the exact solution to this filtering problem involves an exponential growth in the number of mixture…

Machine Learning · Statistics 2023-07-03 Adrian G. Wills , Johannes Hendriks , Christopher Renton , Brett Ninness

The Fokker-Planck equation describes the evolution of the probability density associated with a stochastic differential equation. As the dimension of the system grows, solving this partial differential equation (PDE) using conventional…

Dynamical Systems · Mathematics 2023-06-07 William Anderson , Mohammad Farazmand

To minimize the average of a set of log-convex functions, the stochastic Newton method iteratively updates its estimate using subsampled versions of the full objective's gradient and Hessian. We contextualize this optimization problem as…

Machine Learning · Statistics 2023-08-22 Michael C. Burkhart

Bayesian optimization is highly effective for optimizing expensive-to-evaluate black-box functions, but it faces significant computational challenges due to the cubic per-iteration cost of Gaussian processes, which results in a total time…

Optimization and Control · Mathematics 2026-05-21 Tansheng Zhu , Hongyu Zhou , Ke Jin , Xusheng Xu , Qiufan Yuan , Lijie Ji

Kernel density estimation on a finite interval poses an outstanding challenge because of the well-recognized bias at the boundaries of the interval. Motivated by an application in cancer research, we consider a boundary constraint linking…

Statistics Theory · Mathematics 2020-12-01 Matthew J. Colbrook , Zdravko I. Botev , Karsten Kuritz , Shev MacNamara

Flexible and scalable decentralized learning solutions are fundamentally important in the application of multi-agent systems. While several recent approaches introduce (ensembles of) kernel machines in the distributed setting, Bayesian…

Machine Learning · Computer Science 2025-02-11 Fernando Llorente , Daniel Waxman , Petar M. Djurić

This paper is concerned with the analysis of the kernel-based algorithm for gain function approximation in the feedback particle filter. The exact gain function is the solution of a Poisson equation involving a probability-weighted…

Numerical Analysis · Mathematics 2016-12-19 Amirhossein Taghvaei , Prashant G. Mehta , Sean P. Meyn

We consider the Bayesian optimal filtering problem: i.e. estimating some conditional statistics of a latent time-series signal from an observation sequence. Classical approaches often rely on the use of assumed or estimated transition and…

Machine Learning · Statistics 2023-03-16 Adrian N. Bishop , Edwin V. Bonilla

We propose an adaptive random quantum algorithm to obtain an optimized eigensolver. Specifically, we introduce a general method to parametrize and optimize the probability density function of a random number generator, which is the core of…

We propose a new method for blind system identification. Resorting to a Gaussian regression framework, we model the impulse response of the unknown linear system as a realization of a Gaussian process. The structure of the covariance matrix…

Systems and Control · Computer Science 2016-05-20 Giulio Bottegal , Riccardo S. Risuleo , Håkan Hjalmarsson

The problem of sequentially maximizing the expectation of a function seeks to maximize the expected value of a function of interest without having direct control on its features. Instead, the distribution of such features depends on a given…

Machine Learning · Statistics 2022-10-26 Diego Martinez-Taboada , Dino Sejdinovic

Finding optimal parameter configurations for tunable GPU kernels is a non-trivial exercise for large search spaces, even when automated. This poses an optimization task on a non-convex search space, using an expensive to evaluate function…

Machine Learning · Computer Science 2021-12-01 Floris-Jan Willemsen , Rob van Nieuwpoort , Ben van Werkhoven

Bayesian optimization relies on iteratively constructing and optimizing an acquisition function. The latter turns out to be a challenging, non-convex optimization problem itself. Despite the relative importance of this step, most algorithms…

Optimization and Control · Mathematics 2026-04-22 Yilin Xie , Shiqiang Zhang , Joel A. Paulson , Calvin Tsay

In this work, we propose adaptive deep learning approaches based on normalizing flows for solving fractional Fokker-Planck equations (FPEs). The solution of a FPE is a probability density function (PDF). Traditional mesh-based methods are…

Machine Learning · Computer Science 2022-10-27 Li Zeng , Xiaoliang Wan , Tao Zhou

Gaussian process (GP) regression is a popular surrogate modeling tool for computer simulations in engineering and scientific domains. However, it often struggles with high computational costs and low prediction accuracy when the simulation…

Machine Learning · Computer Science 2025-02-25 Lulu Kang , Minshen Xu