English
Related papers

Related papers: Gradient walk and $p$-harmonic functions

200 papers

Stochastic point processes relevant to the theory of long-range aperiodic order are considered that display diffraction spectra of mixed type, with special emphasis on explicitly computable cases together with a unified approach of…

Mathematical Physics · Physics 2019-07-17 Michael Baake , Matthias Birkner , Robert V. Moody

We consider the problem of minimizing a convex objective which is the sum of a smooth part, with Lipschitz continuous gradient, and a nonsmooth part. Inspired by various applications, we focus on the case when the nonsmooth part is a…

Optimization and Control · Mathematics 2013-08-28 Ting Kei Pong

We consider in this work a system of two stochastic differential equations named the perturbed compositional gradient flow. By introducing a separation of fast and slow scales of the two equations, we show that the limit of the slow motion…

Probability · Mathematics 2018-07-26 Wenqing Hu , Chris Junchi Li

Composite optimization problems, where the sum of a smooth and a merely lower semicontinuous function has to be minimized, are often tackled numerically by means of proximal gradient methods as soon as the lower semicontinuous part of the…

Optimization and Control · Mathematics 2022-07-05 Christian Kanzow , Patrick Mehlitz

Gradient-based methods are widely used to solve various optimization problems, however, they are either constrained by local optima dilemmas, simple convex constraints, and continuous differentiability requirements, or limited to…

Machine Learning · Computer Science 2026-03-19 Ming Li

We present new convolution based smooth approximations to the absolute value function and apply them to construct gradient based algorithms such as the nonlinear conjugate gradient scheme to obtain sparse, regularized solutions of linear…

Numerical Analysis · Mathematics 2015-07-02 Sergey Voronin , Gorkem Ozkaya , Davis Yoshida

Gradient algorithms are classical in adaptive control and parameter estimation. For instantaneous quadratic cost functions they lead to a linear time-varying dynamic system that converges exponentially under persistence of excitation…

Optimization and Control · Mathematics 2020-10-06 Juan G. Rueda-Escobedo , Jaime A. Moreno

In this paper we consider a step function characterized by an arbitrary sequence of real-valued scalars and approximate it with a matching pursuit (MP) algorithm. We utilize a waveform dictionary with rectangular window functions as part of…

Functional Analysis · Mathematics 2022-10-05 Jorge Andres Rivero , Pierluigi Vellucci

Recent studies have shown that many nonconvex machine learning problems satisfy a generalized-smooth condition that extends beyond traditional smooth nonconvex optimization. However, the existing algorithms are not fully adapted to such…

Optimization and Control · Mathematics 2025-10-03 Yufeng Yang , Erin Tripp , Yifan Sun , Shaofeng Zou , Yi Zhou

This paper demonstrates that the space of piecewise smooth functions can be well approximated by the space of functions defined by a set of simple (non-linear) operations on smooth uniform splines. The examples include bivariate functions…

Numerical Analysis · Mathematics 2024-05-13 David Levin

The purpose of this paper is to prove a uniform convergence rate of the solutions of the $p$-Laplace equation $\Delta_p u = 0$ with Dirichlet boundary conditions to the solution of the infinity-Laplace equation $\Delta_\infty u = 0$ as…

Analysis of PDEs · Mathematics 2024-01-23 Leon Bungert

Series representations consisting of spherical harmonics are obtained for characteristic exponents and probability density functions of multivariate stable distributions under various conditions. A esult potentially applicable in a…

Probability · Mathematics 2021-10-18 Zhiyi Chi

Stochastic processes are proposed whose master equations coincide with classical wave, telegraph, and Klein-Gordon equations. Similar to predecessors based on the Goldstein-Kac telegraph process, the model describes the motion of particles…

Statistical Mechanics · Physics 2015-05-18 A. V. Plyukhin

In view of solving convex optimization problems with noisy gradient input, we analyze the asymptotic behavior of gradient-like flows under stochastic disturbances. Specifically, we focus on the widely studied class of mirror descent schemes…

Optimization and Control · Mathematics 2017-09-21 Panayotis Mertikopoulos , Mathias Staudigl

In this paper, we introduce a new subclass of close-to-convex harmonic functions. We present a sufficient coefficient condition for a function to be a member of this class. Furthermore, we establish a distortion theorem. These results lay…

Complex Variables · Mathematics 2025-02-10 Serkan Çakmak , Sibel Yalçin

We show that any periodic with respect to normal subgroups (of the group representation of the Cayley tree) of finite index $p$-harmonic function is a constant. For some normal subgroups of infinite index we describe a class of…

Functional Analysis · Mathematics 2008-03-07 U. A. Rozikov , F. T. Ishankulov

We provide tight finite-time convergence bounds for gradient descent and stochastic gradient descent on quadratic functions, when the gradients are delayed and reflect iterates from $\tau$ rounds ago. First, we show that without stochastic…

Optimization and Control · Mathematics 2018-06-28 Yossi Arjevani , Ohad Shamir , Nathan Srebro

Many complex systems are characterized by intriguing spatio-temporal structures. Their mathematical description relies on the analysis of appropriate correlation functions. Functional integral techniques provide a unifying formalism that…

Statistical Mechanics · Physics 2009-11-12 Uwe C. Tauber

Every convex optimization problem has a dual problem. The $p$-Dirichlet problem in metric measure spaces is an optimization problem whose solutions are $p$-harmonic functions. What is its dual problem? In this paper, we give an answer to…

Metric Geometry · Mathematics 2025-02-04 Sylvester Eriksson-Bique , Saara Sarsa

In this paper, we consider gradient-type methods for convex positively homogeneous optimization problems with relative accuracy. An analogue of the accelerated universal gradient-type method for positively homogeneous optimization problems…

Optimization and Control · Mathematics 2021-12-14 Fedor S. Stonyakin , Seydamet S. Ablaev , Inna V. Baran