English
Related papers

Related papers: Gradient walk and $p$-harmonic functions

200 papers

Let $p$ be a real number greater than one and let $G$ be a connected graph of bounded degree. In this paper we introduce the $p$-harmonic boundary of $G$. We use this boundary to characterize the graphs $G$ for which the constant functions…

Functional Analysis · Mathematics 2010-09-20 Michael J. Puls

We study the approximation of stationary processes by a simple class of purely deterministic signals. This has an analytic counterpart in the approximation of symmetric positive definite Toeplitz matrices by submatrices of finite rank. We…

Probability · Mathematics 2020-09-15 Giorgio Picci , Bin Zhu

In this paper we study the Perron method for solving the p-harmonic Dirichlet problem on the topologist's comb. For functions which are bounded and continuous at the accessible points, we obtain invariance of the Perron solutions under…

Analysis of PDEs · Mathematics 2015-01-19 Anders Björn

In this note we show that conforming Galerkin approximations for p-harmonic functions tend to infinity-harmonic functions in the limit p \to \infty and h \to 0, where h denotes the Galerkin discretisation parameter.

Numerical Analysis · Mathematics 2015-11-03 Tristan Pryer

In this paper we provide a rigorous mathematical foundation for continuous approximations of a class of systems with piece-wise continuous functions. By using techniques from the theory of differential inclusions, the underlying piece-wise…

Chaotic Dynamics · Physics 2014-08-20 Marius-F. Danca

We propose a new stochastic gradient method for optimizing the sum of a finite set of smooth functions, where the sum is strongly convex. While standard stochastic gradient methods converge at sublinear rates for this problem, the proposed…

Optimization and Control · Mathematics 2013-03-12 Nicolas Le Roux , Mark Schmidt , Francis Bach

We discuss various representations of planar $p$-harmonic systems of equations and their solutions. For coordinate functions of $p$-harmonic maps we analyze signs of their Hessians, the Gauss curvature of $p$-harmonic surfaces, the length…

Analysis of PDEs · Mathematics 2013-09-25 Tomasz Adamowicz

In this paper, we define a subclass of sense-preserving harmonic functions associated with a class of analytic functions satisfying a differential inequality. We then establish a close relation between both subclasses. Further, we obtain…

Complex Variables · Mathematics 2024-06-21 Prachi Prajna Dash , Jugal Kishore Prajapat

Classes of target functions containing a large number of approximately orthogonal elements are known to be hard to learn by the Statistical Query algorithms. Recently this classical fact re-emerged in a theory of gradient-based optimization…

Machine Learning · Computer Science 2024-08-30 Rustem Takhanov , Maxat Tezekbayev , Artur Pak , Arman Bolatov , Zhenisbek Assylbekov

A stochastic algorithm is proposed, finding some elements from the set of intrinsic $p$-mean(s) associated to a probability measure $\nu$ on a compact Riemannian manifold and to $p\in[1,\infty)$. It is fed sequentially with independent…

Probability · Mathematics 2016-06-24 Marc Arnaudon , Laurent Miclo

We study the local regularity properties of $(s,p)$-harmonic functions, i.e. local weak solutions to the fractional $p$-Laplace equation of order $s\in (0,1)$ in the case $p\in (1,2]$. It is shown that $(s,p)$-harmonic functions are weakly…

Analysis of PDEs · Mathematics 2024-09-04 Verena Bögelein , Frank Duzaar , Naian Liao , Giovanni Molica Bisci , Raffaella Servadei

We study the streamlines of $\infty$-harmonic functions in planar convex rings. We include convex polygons. The points where streamlines can meet are characterized: they lie on certain curves. The gradient has constant norm along…

Analysis of PDEs · Mathematics 2020-06-30 Erik Lindgren , Peter Lindqvist

Gradient normalization and soft clipping are two popular techniques for tackling instability issues and improving convergence of stochastic gradient descent (SGD) with momentum. In this article, we study these types of methods through the…

Optimization and Control · Mathematics 2025-07-01 Måns Williamson , Tony Stillfjord

Stochastic coordinate descent algorithms are efficient methods in which each iterate is obtained by fixing most coordinates at their values from the current iteration, and approximately minimizing the objective with respect to the remaining…

Machine Learning · Statistics 2025-04-02 Eméric Gbaguidi

The main objective of the present paper is to construct a new class of space-time discretizations for the stochastic $p$-Stokes system and analyze its stability and convergence properties. We derive regularity results for the approximation…

Numerical Analysis · Mathematics 2024-08-07 Kim-Ngan Le , Jörn Wichmann

This paper presents an algorithmic framework for solving unconstrained stochastic optimization problems using only stochastic function evaluations. We employ central finite-difference based gradient estimation methods to approximate the…

Optimization and Control · Mathematics 2025-01-14 Raghu Bollapragada , Cem Karamanli

In this book chapter, we briefly describe the main components that constitute the gradient descent method and its accelerated and stochastic variants. We aim at explaining these components from a mathematical point of view, including…

Optimization and Control · Mathematics 2022-12-20 Quoc Tran-Dinh , Marten van Dijk

This article is concerned with numerical methods to approximate effective coefficients in stochastic homogenization of discrete linear elliptic equations, and their numerical analysis --- which has been made possible by recent contributions…

Numerical Analysis · Mathematics 2012-11-09 A. -C. Egloffe , A. Gloria , J. -C. Mourrat , T. N. Nguyen

This paper is concerned with convergence of stochastic gradient algorithms with momentum terms in the nonconvex setting. A class of stochastic momentum methods, including stochastic gradient descent, heavy ball, and Nesterov's accelerated…

Optimization and Control · Mathematics 2021-10-01 Zixuan Wang , Shanjian Tang

We obtain an asymptotic H\"older estimate for functions satisfying a dynamic programming principle arising from a so-called ellipsoid process. By the ellipsoid process we mean a generalization of the random walk where the next step in the…

Analysis of PDEs · Mathematics 2020-08-05 Ángel Arroyo , Mikko Parviainen