English
Related papers

Related papers: Gradient walk and $p$-harmonic functions

200 papers

Most approximation methods in high dimensions exploit smoothness of the function being approximated. These methods provide poor convergence results for non-smooth functions with kinks. For example, such kinks can arise in the uncertainty…

Numerical Analysis · Mathematics 2019-02-19 Barbara Fuchs , Jochen Garcke

We consider the stochastic approximation problem where a convex function has to be minimized, given only the knowledge of unbiased estimates of its gradients at certain points, a framework which includes machine learning methods based on…

Machine Learning · Computer Science 2013-06-11 Francis Bach , Eric Moulines

Convergence results for averages of independent replications of counting processes are established in a $p$-variation setting and under certain assumptions. Such convergence results can be combined with functional differentiability results…

Probability · Mathematics 2019-03-12 Morten Overgaard

We consider a random process as a solution of stochastic differential equations with dependence of the coefficients on small parameter $\varepsilon$ and we suppose that the drift coefficients of these equations are unbounded on the…

Probability · Mathematics 2023-12-15 Ivan H. Krykun

Continuous time quantum walks on exponentially large, sparse graphs form a powerful paradigm for quantum computing: On the one hand, they can be efficiently simulated on a quantum computer. On the other hand, they are themselves…

Quantum Physics · Physics 2025-12-04 Lilith Zschetzsche , Refik Mansuroglu , András Molnár , Norbert Schuch

We show that asymptotically, completely asynchronous stochastic gradient procedures achieve optimal (even to constant factors) convergence rates for the solution of convex optimization problems under nearly the same conditions required for…

Optimization and Control · Mathematics 2015-08-05 John C. Duchi , Sorathan Chaturapruek , Christopher Ré

We consider the problem of maximizing a convex function over a closed convex set in a real Hilbert space. For linear functions, we show that a single orthogonal projection suffices to obtain an approximate solution. For continuous convex…

Optimization and Control · Mathematics 2026-02-23 Pedro Felzenszwalb , Heon Lee

Accelerated gradient descent iterations are widely used in optimization. It is known that, in the continuous-time limit, these iterations converge to a second-order differential equation which we refer to as the accelerated gradient flow.…

Optimization and Control · Mathematics 2020-06-16 Mohammad Farazmand

This work considers the question: what convergence guarantees does the stochastic subgradient method have in the absence of smoothness and convexity? We prove that the stochastic subgradient method, on any semialgebraic locally Lipschitz…

Optimization and Control · Mathematics 2018-05-29 Damek Davis , Dmitriy Drusvyatskiy , Sham Kakade , Jason D. Lee

Let u, v be two harmonic functions in the disk of radius two which have exactly the same set Z of zeros. We observe that the gradient of \log |u/v| is bounded in the unit disk by a constant which depends on Z only. In case Z is empty this…

Analysis of PDEs · Mathematics 2015-12-02 Dan Mangoubi

We study the Dirichlet problem for p-harmonic functions on metric spaces with respect to arbitrary compactifications. A particular focus is on the Perron method, and as a new approach to the invariance problem we introduce Sobolev-Perron…

Analysis of PDEs · Mathematics 2020-06-05 Anders Björn , Jana Björn , Tomas Sjödin

Complex systems are characterized by a huge number of degrees of freedom often interacting in a non-linear manner. In many cases macroscopic states, however, can be characterized by a small number of order parameters that obey stochastic…

Data Analysis, Statistics and Probability · Physics 2012-02-20 David Kleinhans

We study stochastic gradient descent (SGD) with gradient clipping on convex functions under a generalized smoothness assumption called $(L_0,L_1)$-smoothness. Using gradient clipping, we establish a high probability convergence rate that…

Optimization and Control · Mathematics 2025-06-04 Ofir Gaash , Kfir Yehuda Levy , Yair Carmon

This paper is devoted to the convergence analysis of stochastic approximation algorithms of the form $\theta\_{n+1} = \theta\_n + \gamma\_{n+1} H\_{\theta\_n}(X\_{n+1})$ where $\{\theta\_nn, n \geq 0\}$ is a $R^d$-valued sequence,…

Statistics Theory · Mathematics 2016-01-27 Gersende Fort , Eric Moulines , Amandine Schreck , Matti Vihola

A new method is proposed to numerically extract the diffusivity of a (typically nonlinear) diffusion equation from underlying stochastic particle systems. The proposed strategy requires the system to be in local equilibrium and have…

Statistical Mechanics · Physics 2018-05-09 Peter Embacher , Nicolas Dirr , Johannes Zimmer , Celia Reina

Asynchronous parallel optimization algorithms for solving large-scale machine learning problems have drawn significant attention from academia to industry recently. This paper proposes a novel algorithm, decoupled asynchronous proximal…

Optimization and Control · Mathematics 2016-05-24 Yitan Li , Linli Xu , Xiaowei Zhong , Qing Ling

In a setting, where only exit measures are given, as they are associated with a right continuous strong Markov process on a separable metric space, we provide simple criteria for scaling invariant H\"older continuity of bounded harmonic…

Analysis of PDEs · Mathematics 2016-11-10 Wolfhard Hansen

The main purpose of this thesis is to study the interplay between geometric properties of infinite graphs and analytic and probabilistic objects such as transition operators, harmonic functions and random walks on these graphs. For a…

Probability · Mathematics 2010-12-14 Ecaterina Sava

We systematically develop a learning-based treatment of stochastic optimal control (SOC), relying on direct optimization of parametric control policies. We propose a derivation of adjoint sensitivity results for stochastic differential…

Machine Learning · Computer Science 2021-06-08 Stefano Massaroli , Michael Poli , Stefano Peluchetti , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

We describe two BQP-complete problems concerning properties of sparse graphs having a certain symmetry. The graphs are specified by efficiently computable functions which output the adjacent vertices for each vertex. Let i and j be two…

Quantum Physics · Physics 2007-05-23 Dominik Janzing , Pawel Wocjan