English
Related papers

Related papers: Minimizers and Gradient Flows of Attraction-Repuls…

200 papers

We derive and showcase a novel approach to approximating Fourier transforms in higher dimensions, focusing specifically on the case of 2D radially concentrated ('ring-like') functions. We first reduce the problem to that of evaluating the…

High Energy Astrophysical Phenomena · Physics 2026-04-08 Filip Niewiński , Michael D. Johnson

The problem of efficient approximation of a linear operator induced by the Gaussian or softmax kernel is often addressed using random features (RFs) which yield an unbiased approximation of the operator's result. Such operators emerge in…

Machine Learning · Computer Science 2023-02-03 Valerii Likhosherstov , Krzysztof Choromanski , Avinava Dubey , Frederick Liu , Tamas Sarlos , Adrian Weller

A method of approximating the inverse Radon transform on the plane by integrating against a smooth kernel is investigated. For piecewise smooth integrable functions, convergence theorems are proven and Gibbs phenomena are ruled out.…

Numerical Analysis · Mathematics 2019-10-22 Shavkat Alimov , Joseph David , Alexander Nolte , Julie Sherman

The paper is an investigation of the analytic properties of a new class of special functions that appear in the kernels of a class of integral operators underlying the dynamics of matter relaxation processes in attractive fields. These…

Classical Analysis and ODEs · Mathematics 2020-02-18 Dmitrii B. Karp , Yuri B. Melnikov , Irina V. Turuntaeva

We prove statistical rates of convergence for kernel-based least squares regression from i.i.d. data using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is related to…

Statistics Theory · Mathematics 2016-07-11 Gilles Blanchard , Nicole Krämer

We investigate the strong convergence properties of a proximal-gradient inertial algorithm with two Tikhonov regularization terms in connection to the minimization problem of the sum of a convex lower semi-continuous function $f$ and a…

Optimization and Control · Mathematics 2024-07-16 Szilárd Csaba László

Multivariate functions encountered in high-dimensional uncertainty quantification problems often vary most strongly along a few dominant directions in the input parameter space. We propose a gradient-based method for detecting these…

Analysis of PDEs · Mathematics 2019-11-11 Olivier Zahm , Paul Constantine , Clémentine Prieur , Youssef Marzouk

We propose inferential tools for functional linear quantile regression where the conditional quantile of a scalar response is assumed to be a linear functional of a functional covariate. In contrast to conventional approaches, we employ…

Statistics Theory · Mathematics 2022-02-25 Peijun Sang , Zuofeng Shang , Pang Du

The popular cubic smoothing spline estimate of a regression function arises as the minimizer of the penalized sum of squares $\sum_j(Y_j - {\mu}(t_j))^2 + {\lambda}\int_a^b [{\mu}"(t)]^2 dt$, where the data are $t_j,Y_j$, $j=1,..., n$. The…

Machine Learning · Statistics 2011-11-09 Nancy Heckman

Value approximation using deep neural networks is at the heart of off-policy deep reinforcement learning, and is often the primary module that provides learning signals to the rest of the algorithm. While multi-layer perceptron networks are…

Machine Learning · Computer Science 2022-06-10 Ge Yang , Anurag Ajay , Pulkit Agrawal

We study the quantitative convergence of drift-diffusion PDEs that arise as Wasserstein gradient flows of linearly convex functions over the space of probability measures on ${\mathbb R}^d$. In this setting, the objective is in general not…

Optimization and Control · Mathematics 2025-07-17 Lénaïc Chizat , Maria Colombo , Xavier Fernández-Real

We study the asymptotic shape of the trajectory of the stochastic gradient descent algorithm applied to a convex objective function. Under mild regularity assumptions, we prove a functional central limit theorem for the properly rescaled…

Machine Learning · Statistics 2026-02-18 Kessang Flamand , Victor-Emmanuel Brunel

We propose here a proof of existence of a minimizer of a segmentation functional based on a priori information on target shapes, and formulated with level sets. The existence of a minimizer is very important, because it guarantees the…

Classical Analysis and ODEs · Mathematics 2022-10-25 El Hadji S. Diop , Valérie Burdin , V. B. Surya Prasath

We estimate the quantum state of a light beam from results of quantum homodyne measurements performed on identically prepared quantum systems. The state is represented through the Wigner function, a generalized probability density on…

Statistics Theory · Mathematics 2011-06-23 Cristina Butucea , Madalin Guţa , Luis Artiles

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

Optimization and Control · Mathematics 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

The Bayesian update can be viewed as a variational problem by characterizing the posterior as the minimizer of a functional. The variational viewpoint is far from new and is at the heart of popular methods for posterior approximation.…

Statistics Theory · Mathematics 2018-11-05 Nicolas Garcia Trillos , Daniel Sanz-Alonso

Kernel methods are powerful learning methodologies that allow to perform non-linear data analysis. Despite their popularity, they suffer from poor scalability in big data scenarios. Various approximation methods, including random feature…

Machine Learning · Statistics 2022-06-14 Bharath Sriperumbudur , Nicholas Sterge

For a class of stochastic models with Gaussian and rough mean-reverting volatility that embeds the genuine rough Stein-Stein model, we study the weak approximation rate when using a Euler type scheme with integrated kernels. Our first…

Probability · Mathematics 2026-02-23 Aurélien Alfonsi , Ahmed Kebaier

Random Fourier features (RFF) represent one of the most popular and wide-spread techniques in machine learning to scale up kernel algorithms. Despite the numerous successful applications of RFFs, unfortunately, quite little is understood…

Machine Learning · Statistics 2019-02-12 Zoltan Szabo , Bharath K. Sriperumbudur

This paper deals with local criteria for the convergence to a global minimiser for gradient flow trajectories and their discretisations. To obtain quantitative estimates on the speed of convergence, we consider variations on the classical…

Optimization and Control · Mathematics 2024-05-01 Lorenzo Dello Schiavo , Jan Maas , Francesco Pedrotti