English
Related papers

Related papers: Learning Memory Kernels in Generalized Langevin Eq…

200 papers

Finding the dynamical law of observable quantities lies at the core of physics. Within the particular field of statistical mechanics, the generalized Langevin equation (GLE) comprises a general model for the evolution of observables…

Statistical Mechanics · Physics 2022-11-22 Antonio Russo , Miguel A. Duran-Olivencia , Ioannis G. Kevrekidis , Serafim Kalliadasis

Regularized empirical risk minimization including support vector machines plays an important role in machine learning theory. In this paper regularized pairwise learning (RPL) methods based on kernels will be investigated. One example is…

Statistics Theory · Mathematics 2015-10-13 Andreas Christmann , Ding-Xuan Zhou

We study the statistically invariant structures of the nonlinear generalized Langevin equation (GLE) with a power-law memory kernel. For a broad class of memory kernels, including those in the subdiffusive regime, we construct solutions of…

Probability · Mathematics 2023-01-10 David P. Herzog , Jonathan C. Mattingly , Hung D. Nguyen

Many algorithms in computer vision and robotics make strong assumptions about uncertainty, and rely on the validity of these assumptions to produce accurate and consistent state estimates. In practice, dynamic environments may degrade…

Robotics · Computer Science 2017-08-04 Valentin Peretroukhin , William Vega-Brown , Nicholas Roy , Jonathan Kelly

The asymptotically precise estimation of the generalization of kernel methods has recently received attention due to the parallels between neural networks and their associated kernels. However, prior works derive such estimates for training…

Machine Learning · Computer Science 2024-03-19 Maksim Velikanov , Maxim Panov , Dmitry Yarotsky

This paper studies the generalization properties of a recently proposed kernel method, the Random Feature models with Learnable Activation Functions (RFLAF). By applying a data-dependent sampling scheme for generating features, we provide…

Machine Learning · Computer Science 2025-10-20 Zailin Ma , Jiansheng Yang , Yaodong Yang

We propose a nonparametric method to learn the L\'evy density from probability density data governed by a nonlocal Fokker-Planck equation. We recast the problem as identifying the kernel in a nonlocal integral operator from discrete data,…

Numerical Analysis · Mathematics 2025-12-30 Luxuan Yang , Fei Lu , Ting Gao , Wei Wei , Jinqiao Duan

We study a compositional variant of kernel ridge regression in which the predictor is applied to a coordinate-wise reweighting of the inputs. Formulated as a variational problem, this model provides a simple testbed for feature learning in…

Machine Learning · Computer Science 2025-11-05 Feng Ruan , Keli Liu , Michael Jordan

Conditional expectiles are becoming an increasingly important tool in finance as well as in other areas of applications. We analyse a support vector machine type approach for estimating conditional expectiles and establish learning rates…

Machine Learning · Statistics 2017-02-28 Muhammad Farooq , Ingo Steinwart

In this work, we introduce a spatio-temporal kernel for Gaussian process (GP) regression-based sound field estimation. Notably, GPs have the attractive property that the sound field is a linear function of the measurements, allowing the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 David Sundström , Shoichi Koyama , Andreas Jakobsson

Kernel logistic regression (KLR) is a powerful classification method widely applied across diverse domains. In many real-world scenarios, indefinite kernels capture more domain-specific structural information than positive definite kernels.…

Machine Learning · Statistics 2025-10-31 Shaoxin Wang , Hanjing Yao

Graph neural networks (GNNs) have become a powerful tool for processing graph-structured data but still face challenges in effectively aggregating and propagating information between layers, which limits their performance. We tackle this…

Machine Learning · Computer Science 2023-02-09 Maxim Fishman , Chaim Baskin , Evgenii Zheltonozhskii , Almog David , Ron Banner , Avi Mendelson

We investigate the problem of estimating a function $f$ based on observations from its noisy convolution when the noise exhibits long-range dependence. We construct an adaptive estimator based on the kernel method, derive minimax lower…

Statistics Theory · Mathematics 2017-06-28 Rida Benhaddou

We present a derivation of a coarse-grained model from the Langevin dynamics. The focus is placed on the memory kernel function and the fluctuation-dissipation theorem. Also presented is an hierarchy of approximations for the memory and…

Numerical Analysis · Mathematics 2019-10-04 Lina Ma , Xiantao Li , Chun Liu

We develop novel learning rates for conditional mean embeddings by applying the theory of interpolation for reproducing kernel Hilbert spaces (RKHS). We derive explicit, adaptive convergence rates for the sample estimator under the…

Machine Learning · Statistics 2026-04-09 Prem Talwai , Ali Shameli , David Simchi-Levi

We introduce a novel kernel-based framework for learning differential equations and their solution maps that is efficient in data requirements, in terms of solution examples and amount of measurements from each example, and computational…

Machine Learning · Statistics 2025-04-07 Yasamin Jalalian , Juan Felipe Osorio Ramirez , Alexander Hsu , Bamdad Hosseini , Houman Owhadi

Kernel methods are one of the cornerstones of learning-based control, modern system identification, surrogate modelling, and related fields. A key advantage of this class of learning and function approximation methods is the availability of…

Numerical Analysis · Mathematics 2026-05-20 Tizian Wenzel , Abdullah Tokmak , Christian Fiedler

Machine learning is a powerful method of extracting meaning from data; unfortunately, current digital hardware is extremely energy-intensive. There is interest in an alternative analog computing implementation that could match the…

Machine Learning · Computer Science 2026-02-17 Jonathan Lin , Aman Desai , Frank Barrows , Francesco Caravelli

Kernel regression is a popular non-parametric fitting technique. It aims at learning a function which estimates the targets for test inputs as precise as possible. Generally, the function value for a test input is estimated by a weighted…

Machine Learning · Computer Science 2017-12-27 Rongqing Huang , Shiliang Sun

We consider the problem of training a neural network to store a set of patterns with maximal noise robustness. A solution, in terms of optimal weights and state update rules, is derived by training each individual neuron to perform either…

Neural and Evolutionary Computing · Computer Science 2024-07-24 Georgios Iatropoulos , Johanni Brea , Wulfram Gerstner