English
Related papers

Related papers: An iterative process for approximating subactions

200 papers

We apply a common measure of randomness, the entropy, in the context of iterated functions on a finite set with n elements. For a permutation, it turns out that this entropy is asymptotically (for a growing number of iterations) close to…

Number Theory · Mathematics 2017-12-20 Joachim von zur Gathen

In large-scale applications, such as machine learning, it is desirable to design non-convex optimization algorithms with a high degree of parallelization. In this work, we study the adaptive complexity of finding a stationary point, which…

Optimization and Control · Mathematics 2025-05-15 Huanjian Zhou , Andi Han , Akiko Takeda , Masashi Sugiyama

Randomized higher-order computation can be seen as being captured by a lambda calculus endowed with a single algebraic operation, namely a construct for binary probabilistic choice. What matters about such computations is the probability of…

Logic in Computer Science · Computer Science 2020-12-24 Ugo Dal Lago , Claudia Faggian , Simona Ronchi Della Rocca

In this paper, we investigate the trade-off between convergence rate and computational cost when minimizing a composite functional with proximal-gradient methods, which are popular optimisation tools in machine learning. We consider the…

Machine Learning · Computer Science 2012-10-23 Pierre Machart , Sandrine Anthoine , Luca Baldassarre

Proximal operations are among the most common primitives appearing in both practical and theoretical (or high-level) optimization methods. This basic operation typically consists in solving an intermediary (hopefully simpler) optimization…

Optimization and Control · Mathematics 2021-06-30 Mathieu Barré , Adrien Taylor , Francis Bach

The problem of approximating/tracking the value of a Wiener process is considered. The discretization points are placed at times when the value of the process differs from the approximation by some amount, here denoted by eta. It is found…

Probability · Mathematics 2010-02-03 Mats Brodén , Magnus Wiktorsson

The convergence theory for the gradient sampling algorithm is extended to directionally Lipschitz functions. Although directionally Lipschitz functions are not necessarily locally Lipschitz, they are almost everywhere differentiable and…

Optimization and Control · Mathematics 2021-07-13 James V. Burke , Qiuying Lin

We analyze a simple randomized subgradient method for approximating solutions to stochastic systems of convex functional constraints, the only input to the algorithm being the size of minibatches. By introducing a new notion of what is…

Optimization and Control · Mathematics 2021-08-30 James Renegar , Song Zhou

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

Optimization and Control · Mathematics 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

In this paper we propose a stochastic primal dual fixed point method (SPDFP) for solving the sum of two proper lower semi-continuous convex function and one of which is composite. The method is based on the primal dual fixed point method…

Optimization and Control · Mathematics 2020-04-21 YaNanZhu , XiaoqunZhang

The goal of the paper is to design sequential strategies which lead to efficient optimization of an unknown function under the only assumption that it has a finite Lipschitz constant. We first identify sufficient conditions for the…

Machine Learning · Statistics 2017-06-19 Cédric Malherbe , Nicolas Vayatis

In this work, we analyze two of the most fundamental algorithms in geodesically convex optimization: Riemannian gradient descent and (possibly inexact) Riemannian proximal point. We quantify their rates of convergence and produce different…

Optimization and Control · Mathematics 2024-03-18 David Martínez-Rubio , Christophe Roux , Sebastian Pokutta

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

Optimization and Control · Mathematics 2020-05-05 Andrei Patrascu

We describe an approximate dynamic programming approach to compute lower bounds on the optimal value function for a discrete time, continuous space, infinite horizon setting. The approach iteratively constructs a family of lower bounding…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Paul N. Beuchat , Joseph Warrington , John Lygeros

The (conditional or unconditional) distribution of the continuous scan statistic in a one-dimensional Poisson process may be approximated by that of a discrete analogue via time discretization (to be referred to as the discrete…

Probability · Mathematics 2016-02-09 Yi-Ching Yao , Daniel Wei-Chung Miao , Xenos Chang-Shuo Lin

We calculate the two-point correlation function <x(t2)x(t1)> for a subdiffusive continuous time random walk in a parabolic potential, generalizing well-known results for the single-time statistics to two times. A closed analytical…

Statistical Mechanics · Physics 2009-11-13 A. Baule , R. Friedrich

We develop a diffusion approximation for systems subject to fast random resetting by small amplitudes. Equivalently, this describes systems with frequent but small catastrophes. We demonstrate the validity of the approximation by computing…

Statistical Mechanics · Physics 2026-02-26 Tobias Galla

This paper investigates the asymptotic convergence behavior of high-order proximal-point algorithms (HiPPA) toward global minimizers, extending the analysis beyond sublinear convergence rate results. Specifically, we consider the proximal…

Optimization and Control · Mathematics 2025-05-28 Masoud Ahookhosh , Alfredo Iusem , Alireza Kabgani , Felipe Lara

We consider a version of the continuum armed bandit where an action induces a filtered realisation of a non-homogeneous Poisson process. Point data in the filtered sample are then revealed to the decision-maker, whose reward is the total…

Machine Learning · Computer Science 2020-07-21 James A. Grant , Roberto Szechtman

The focus of this article is the approximation of functions which are analytic on a compact interval except at the endpoints. Typical numerical methods for approximating such functions depend upon the use of particular conformal maps from…

Numerical Analysis · Mathematics 2014-05-05 Ben Adcock , Mark Richardson
‹ Prev 1 4 5 6 7 8 10 Next ›