English
Related papers

Related papers: Learning Transfer Operators by Kernel Density Esti…

200 papers

Wasserstein gradient and Hamiltonian flows have emerged as essential tools for modeling complex dynamics in the natural sciences, with applications ranging from partial differential equations (PDEs) and optimal transport to quantum…

Numerical Analysis · Mathematics 2025-11-11 Jianyu Hu , Juan-Pablo Ortega , Daiying Yin

We develop deep learning-based approximation methods for fully nonlinear second-order PDEs on separable Hilbert spaces, such as HJB equations for infinite-dimensional control, by parameterizing solutions via Hilbert--Galerkin Neural…

Machine Learning · Computer Science 2026-03-23 Samuel N. Cohen , Filippo de Feo , Jackson Hebner , Justin Sirignano

This paper studies Kernel Density Estimation for a high-dimensional distribution $\rho(x)$. Traditional approaches have focused on the limit of large number of data points $n$ and fixed dimension $d$. We analyze instead the regime where…

Machine Learning · Computer Science 2024-10-21 Giulio Biroli , Marc Mézard

The velocity distributions of stellar tracers in general exhibit weak non-Gaussianity encoding information on the orbital composition of a galaxy and the underlying potential. The standard solution for measuring non-Gaussianity involves…

Astrophysics of Galaxies · Physics 2020-10-28 Jason L. Sanders , N. Wyn Evans

We introduce kernel density machines (KDM), an agnostic kernel-based framework for learning the Radon-Nikodym derivative (density) between probability measures under minimal assumptions. KDM applies to general measurable spaces and avoids…

Machine Learning · Statistics 2026-03-27 Andrea Della Vecchia , Damir Filipovic , Paul Schneider

This manuscript presents an algorithm for obtaining an approximation of a nonlinear high order control affine dynamical system. Controlled trajectories of the system are leveraged as the central unit of information via embedding them in…

Optimization and Control · Mathematics 2026-01-23 Moad Abudia , Tejasvi Channagiri , Joel A. Rosenfeld , Rushikesh Kamalapurkar

Simulations of high-energy density physics often need non-local thermodynamic equilibrium (NLTE) opacity data. This data, however, is expensive to produce at relatively low-fidelity. It is even more so at high-fidelity such that the opacity…

Computational Physics · Physics 2023-01-25 Michael D. Vander Wal , Ryan G. McClarren , Kelli D. Humbird

We introduce the Multilevel Euler-Maruyama (ML-EM) method compute solutions of SDEs and ODEs using a range of approximators $f^1,\dots,f^k$ to the drift $f$ with increasing accuracy and computational cost, only requiring a few evaluations…

Machine Learning · Computer Science 2026-03-26 Arthur Jacot

It is well-known that non-linear approximation has an advantage over linear schemes in the sense that it provides comparable approximation rates to those of the linear schemes, but to a larger class of approximands. This was established for…

Classical Analysis and ODEs · Mathematics 2010-04-28 Thomas Hangelbroek , Amos Ron

Density estimation is a central task in statistics and machine learning. This problem aims to determine the underlying probability density function that best aligns with an observed data set. Some of its applications include statistical…

Markov Chain Monte Carlo approach is frequently used within Bayesian framework to sample the target posterior distribution. Its efficiency strongly depends on the proposal used to build the chain. The best jump proposal is the one that…

Instrumentation and Methods for Astrophysics · Physics 2023-02-01 Mikel Falxa , Stanislav Babak , Maude Le Jeune

In this paper we address the problem of estimating the ratio $\frac{q}{p}$ where $p$ is a density function and $q$ is another density, or, more generally an arbitrary function. Knowing or approximating this ratio is needed in various…

Machine Learning · Computer Science 2013-04-26 Qichao Que , Mikhail Belkin

In the paper, we consider the problem of robust approximation of transfer Koopman and Perron-Frobenius (P-F) operators from noisy time series data. In most applications, the time-series data obtained from simulation or experiment is…

Optimization and Control · Mathematics 2020-01-08 Subhrajit Sinha , Huang Bowen , Umesh Vaidya

In recent years, transfer learning has garnered significant attention. Its ability to leverage knowledge from related studies to improve generalization performance in a target study has made it highly appealing. This paper focuses on…

Machine Learning · Statistics 2025-10-30 Chao Wang , Caixing Wang , Xin He , Xingdong Feng

Federated learning must address heterogeneity, strict communication and computation limits, and privacy while ensuring performance. We propose an operator-theoretic framework that maps the $L^2$-optimal solution into a reproducing kernel…

This paper introduces a novel approach to probabilistic deep learning, kernel density matrices, which provide a simpler yet effective mechanism for representing joint probability distributions of both continuous and discrete random…

Machine Learning · Computer Science 2024-05-01 Fabio A. González , Raúl Ramos-Pollán , Joseph A. Gallego-Mejia

Bayesian optimisation is a popular technique for hyperparameter learning but typically requires initial exploration even in cases where similar prior tasks have been solved. We propose to transfer information across tasks using learnt…

Machine Learning · Statistics 2019-05-28 Ho Chung Leon Law , Peilin Zhao , Lucian Chan , Junzhou Huang , Dino Sejdinovic

This paper considers black- and grey-box continuous-time transfer function estimation from frequency response measurements. The first contribution is a bilinear mapping of the original problem from the imaginary axis onto the unitdisk. This…

Systems and Control · Electrical Eng. & Systems 2020-03-16 Ahmet Arda Ozdemir , Suat Gumussoy

Morden deep ensembles technique achieves strong uncertainty estimation performance by going through multiple forward passes with different models. This is at the price of a high storage space and a slow speed in the inference (test) time.…

Machine Learning · Computer Science 2024-03-13 Ha Manh Bui , Anqi Liu

Kernel density estimation, a.k.a. Parzen windows, is a popular density estimation method, which can be used for outlier detection or clustering. With multivariate data, its performance is heavily reliant on the metric used within the…

Machine Learning · Computer Science 2012-12-11 Nicolas Le Roux , Francis Bach