English
Related papers

Related papers: A probabilistic method for gradient estimates of s…

200 papers

Geometric quantiles are popular location functionals to build rank-based statistical procedures in multivariate settings. They are obtained through the minimization of a non-smooth convex objective function. As a result, the singularity of…

Statistics Theory · Mathematics 2026-02-11 Dimitri Konen , Gilles Stupfler

A classic approach in dynamical systems is to use particular geometric structures to deduce statistical properties, for example the existence of invariant measures with stochastic-like behaviour such as large deviations or decay of…

Dynamical Systems · Mathematics 2012-09-14 José F. Alves , Jorge Milhazes Freitas , Stefano Luzzatto , Sandro Vaienti

In this work, we investigate links between the formulation of the flow of marginals of reversible diffusion processes as gradient flows in the space of probability measures and path wise large deviation principles for sequences of such…

Probability · Mathematics 2014-05-16 Max Fathi

We introduce local expectation gradients which is a general purpose stochastic variational inference algorithm for constructing stochastic gradients through sampling from the variational distribution. This algorithm divides the problem of…

Machine Learning · Statistics 2015-03-06 Michalis K. Titsias

This paper is devoted to the robust approximation with a variational phase field approach of multiphase mean curvature flows with possibly highly contrasted mobilities. The case of harmonically additive mobilities has been addressed…

Numerical Analysis · Mathematics 2022-09-20 Eric Bonnetier , Elie Bretin , Simon Masnou

We firstly propose the new stochastic gradient estimate of unbiasedness and minimized variance in this paper. Secondly, we propose the two algorithms: Algorithml and Algorithm2 which apply the new stochastic gradient estimate to modern…

Optimization and Control · Mathematics 2023-06-02 Feifei Gao , Caixia Kou

Stochastic optimization methods have been hugely successful in making large-scale optimization problems feasible when computing the full gradient is computationally prohibitive. Using the theory of modified equations for numerical…

Optimization and Control · Mathematics 2023-09-06 Stefano Di Giovacchino , Desmond J. Higham , Konstantinos Zygalakis

A machine-learning strategy for investigating the stability of fluid flow problems is proposed herein. The goal is to provide a simple yet robust methodology to find a nonlinear mapping from the parametric space to an indicator representing…

Fluid Dynamics · Physics 2026-01-06 David J. Silvester

This paper reviews the gradient sampling methodology for solving nonsmooth, nonconvex optimization problems. An intuitively straightforward gradient sampling algorithm is stated and its convergence properties are summarized. Throughout this…

Optimization and Control · Mathematics 2018-05-01 James V. Burke , Frank E. Curtis , Adrian S. Lewis , Michael L. Overton , Lucas E. A. Simões

Along with Markov chain Monte Carlo (MCMC) methods, variational inference (VI) has emerged as a central computational approach to large-scale Bayesian inference. Rather than sampling from the true posterior $\pi$, VI aims at producing a…

Machine Learning · Statistics 2023-04-24 Marc Lambert , Sinho Chewi , Francis Bach , Silvère Bonnabel , Philippe Rigollet

We investigate the properties of the combinatorial Ricci flow for surfaces, both forward and backward -- existence, uniqueness and singularities formation. We show that the positive results that exist for the smooth Ricci flow also hold for…

Differential Geometry · Mathematics 2011-06-09 Emil Saucan

Modes and ridges of the probability density function behind observed data are useful geometric features. Mode-seeking clustering assigns cluster labels by associating data samples with the nearest modes, and estimation of density ridges…

Machine Learning · Statistics 2018-04-03 Hiroaki Sasaki , Takafumi Kanamori , Aapo Hyvärinen , Gang Niu , Masashi Sugiyama

Bayesian inference problems require sampling or approximating high-dimensional probability distributions. The focus of this paper is on the recently introduced Stein variational gradient descent methodology, a class of algorithms that rely…

Machine Learning · Statistics 2023-02-14 A. Duncan , N. Nuesken , L. Szpruch

In this work, we present a novel approach for solving stochastic shape optimization problems. Our method is the extension of the classical stochastic gradient method to infinite-dimensional shape manifolds. We prove convergence of the…

Optimization and Control · Mathematics 2020-11-03 Caroline Geiersbach , Estefania Loayza-Romero , Kathrin Welker

In this paper, we propose a type of Ricci flow on graphs where the probability distribution for the Lin-Lu-Yau curvature remains constant over time, and also study the related Forman curvature flow. These two curvature flows coincide on…

Differential Geometry · Mathematics 2026-01-07 Shuliang Bai , Shuang Liu , Xin Lai

In deterministic optimization, line searches are a standard tool ensuring stability and efficiency. Where only stochastic gradients are available, no direct equivalent has so far been formulated, because uncertain gradients do not allow for…

Machine Learning · Computer Science 2017-07-03 Maren Mahsereci , Philipp Hennig

In deterministic optimization, line searches are a standard tool ensuring stability and efficiency. Where only stochastic gradients are available, no direct equivalent has so far been formulated, because uncertain gradients do not allow for…

Machine Learning · Computer Science 2016-01-19 Maren Mahsereci , Philipp Hennig

We present a new method for stochastic shape optimisation of engineering structures. The method generalises an existing deterministic scheme, in which the structure is represented and evolved by a level-set method coupled with mathematical…

Statistical Mechanics · Physics 2017-09-13 Lester O. Hedges , H. Alicia Kim , Robert L. Jack

We propose a new stochastic gradient method for optimizing the sum of a finite set of smooth functions, where the sum is strongly convex. While standard stochastic gradient methods converge at sublinear rates for this problem, the proposed…

Optimization and Control · Mathematics 2013-03-12 Nicolas Le Roux , Mark Schmidt , Francis Bach

A lattice based method will be presented for numerical investigations of Ricci flow. The method will be applied to the particular case of 2-dimensional axially symmetric initial data on manifolds with S^2 topology. Results will be presented…

Differential Geometry · Mathematics 2015-12-14 Leo Brewin
‹ Prev 1 8 9 10 Next ›