English
Related papers

Related papers: Gradient density estimation in arbitrary finite di…

200 papers

The stochastic three points (STP) algorithm is a derivative-free optimization technique designed for unconstrained optimization problems in $\mathbb{R}^d$. In this paper, we analyze this algorithm for three classes of functions: smooth…

Optimization and Control · Mathematics 2026-02-11 Taha El Bakkali El Kadi , Omar Saadi

We consider the minimization of a function defined on a Riemannian manifold $\mathcal{M}$ accessible only through unbiased estimates of its gradients. We develop a geometric framework to transform a sequence of slowly converging iterates…

Machine Learning · Computer Science 2018-06-11 Nilesh Tripuraneni , Nicolas Flammarion , Francis Bach , Michael I. Jordan

This paper considers non-smooth optimization problems where we seek to minimize the pointwise maximum of a continuously parameterized family of functions. Since the objective function is given as the solution to a maximization problem,…

Optimization and Control · Mathematics 2026-01-12 Dimitris Boskos , Jorge Cortés , Sonia Martínez

In this paper we focus on the linear functionals defining an approximate version of the gradient of a function. These functionals are often used when dealing with optimization problems where the computation of the gradient of the objective…

Optimization and Control · Mathematics 2021-05-21 Marco Boresta , Tommaso Colombo , Alberto De Santis , Stefano Lucidi

This paper deals with the dynamics - driven by the gradient flow of negative fractional seminorms - of empirical measures towards equi-spaced ground states. Specifically, we consider periodic empirical measures $\mu$ on the real line that…

Functional Analysis · Mathematics 2025-05-29 Lucia De Luca , Michael Goldman , Marcello Ponsiglione

The integrated density of states (IDS) is a fundamental spectral quantity for quantum Hamiltonians modeling condensed matter systems, describing how densely energy levels are distributed. It can be interpreted as a volume-averaged spectral…

Statistics Theory · Mathematics 2026-02-23 Max Kämper , Christoph Schumacher , Fabian Schwarzenberger , Ivan Veselic

Gradient matching with Gaussian processes is a promising tool for learning parameters of ordinary differential equations (ODE's). The essence of gradient matching is to model the prior over state variables as a Gaussian process which…

Machine Learning · Statistics 2016-10-25 Nico S. Gorbach , Stefan Bauer , Joachim M. Buhmann

An algorithm is proposed, analyzed, and tested for minimizing locally Lipschitz objective functions that may be nonconvex and/or nonsmooth. The algorithm, which is built upon the gradient-sampling methodology, is designed specifically for…

Optimization and Control · Mathematics 2026-04-02 Albert S. Berahas , Frank E. Curtis , Lara Zebiane

Katz and Sarnak conjectured a correspondence between the $n$-level density statistics of zeros from families of $L$-functions with eigenvalues from random matrix ensembles. In many cases the sums of smooth test functions, whose Fourier…

Number Theory · Mathematics 2024-09-10 Elżbieta Bołdyriew , Fangu Chen , Charles Devlin VI , Steven J. Miller , Jason Zhao

This paper proposes a new framework to regularize the highly ill-posed and non-linear phase retrieval problem through deep generative priors using simple gradient descent algorithm. We experimentally show effectiveness of proposed algorithm…

Machine Learning · Computer Science 2018-08-20 Fahad Shamshad , Ali Ahmed

The aim of this paper is to establish the uniform convergence of the densities of a sequence of random variables, which are functionals of an underlying Gaussian process, to a normal density. Precise estimates for the uniform distance are…

Probability · Mathematics 2013-08-30 Yaozhong Hu , Fei Lu , David Nualart

A random Gaussian density field contains a fixed amount of Fisher information on the amplitude of its power spectrum. For a given smoothing scale, however, that information is not evenly distributed throughout the smoothed field. We…

Cosmology and Nongalactic Astrophysics · Physics 2025-12-23 Andrew Repp , Ravi K. Sheth , Istvan Szapudi , Yan-Chuan Cai

This work studies how to estimate the mean-field density of large-scale systems in a distributed manner. Such problems are motivated by the recent swarm control technique that uses mean-field approximations to represent the collective…

Systems and Control · Electrical Eng. & Systems 2021-12-21 Tongjia Zheng , Qing Han , Hai Lin

We present a new microscopic ODE-based model for pedestrian dynamics: the Gradient Navigation Model. The model uses a superposition of gradients of distance functions to directly change the direction of the velocity vector. The velocity is…

Mathematical Physics · Physics 2014-06-11 Felix Dietrich , Gerta Köster

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

We consider the problem of minimizing the sum of two convex functions: one is the average of a large number of smooth component functions, and the other is a general convex function that admits a simple proximal mapping. We assume the whole…

Optimization and Control · Mathematics 2014-03-20 Lin Xiao , Tong Zhang

Recent studies have shown that many nonconvex machine learning problems satisfy a generalized-smooth condition that extends beyond traditional smooth nonconvex optimization. However, the existing algorithms are not fully adapted to such…

Optimization and Control · Mathematics 2025-10-03 Yufeng Yang , Erin Tripp , Yifan Sun , Shaofeng Zou , Yi Zhou

Stein's method for Gaussian process approximation can be used to bound the differences between the expectations of smooth functionals $h$ of a c\`adl\`ag random process $X$ of interest and the expectations of the same functionals of a well…

Probability · Mathematics 2024-02-15 A. D. Barbour , Nathan Ross , Guangqu Zheng

We prove a sharp asymptotic formula for certain oscillatory integrals that may be approached using the stationary phase method. The estimates are uniform in terms of auxiliary parameters, which is crucial for application in analytic number…

Classical Analysis and ODEs · Mathematics 2019-08-28 Eren Mehmet Kiral , Ian Petrow , Matthew P. Young

We study stochastic homogenisation of free-discontinuity surface functionals defined on piecewise rigid functions which arise in the study of fracture in brittle materials. In particular, under standard assumptions on the density, we show…

Analysis of PDEs · Mathematics 2023-12-20 Antonio Flavio Donnarumma , Manuel Friedrich
‹ Prev 1 3 4 5 6 7 10 Next ›