English
Related papers

Related papers: Quantitative results on a Halpern-type proximal po…

200 papers

In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach exploits closed-form…

Machine Learning · Statistics 2015-06-02 Nicholas G. Polson , James G. Scott , Brandon T. Willard

This paper proposes an accelerated proximal point method for maximally monotone operators. The proof is computer-assisted via the performance estimation problem approach. The proximal point method includes various well-known convex…

Optimization and Control · Mathematics 2021-03-25 Donghwan Kim

Employing the ideas of non-linear preconditioning and testing of the classical proximal point method, we formalise common arguments in convergence rate and convergence proofs of optimisation methods to the verification of a simple…

Optimization and Control · Mathematics 2020-10-06 Tuomo Valkonen

Midzuno sampling enables to estimate ratios unbiasedly. We prove the asymptotic normality for estimators of totals and ratios under Midzuno sampling. We also propose consistent variance estimators.

Statistics Theory · Mathematics 2019-10-17 Guillaume Chauvet

Proximal operators are now ubiquitous in non-smooth optimization. Since their introduction in the seminal work of Moreau, many papers have shown their effectiveness on a wide variety of problems, culminating in their use to construct…

Optimization and Control · Mathematics 2026-02-03 Guillaume Lauga , Samuel Vaiter

We consider a bilevel problem involving two monotone equilibrium bifunctions and we show that this problem can be solved by a proximal point method with generalized proximal distances. We propose a framework for the convergence analysis of…

Optimization and Control · Mathematics 2014-07-09 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , P. A. Soares , A. Soubeyran

This paper is devoted to two different two-time-scale stochastic approximation algorithms for superquantile estimation. We shall investigate the asymptotic behavior of a Robbins-Monro estimator and its convexified version. Our main…

Statistics Theory · Mathematics 2020-07-30 Bernard Bercu , Manon Costa , Sébastien Gadat

Proximal point algorithm has found many applications, and it has been playing fundamental roles in the understanding, design, and analysis of many first-order methods. In this paper, we derive the tight convergence rate in subgradient norm…

Optimization and Control · Mathematics 2023-01-10 Guoyong Gu , Junfeng Yang

In this note we point out that results on the asymptotic behaviour of an alternative iterative method are corollaries of corresponding results on the well-known Halpern iteration.

Functional Analysis · Mathematics 2015-04-09 Laurentiu Leustean , Adriana Nicolae

Our first result is a rate of metastability in the sense of Tao for Bruck's iteration scheme for demicontinuous pseudocontractions in Hilbert space, extracted from Bruck's original proof. This result generalizes earlier work in the ongoing…

Logic · Mathematics 2016-10-04 Daniel Körnlein

We prove novel convergence results for a stochastic proximal gradient algorithm suitable for solving a large class of convex optimization problems, where a convex objective function is given by the sum of a smooth and a possibly non-smooth…

Optimization and Control · Mathematics 2016-08-11 Lorenzo Rosasco , Silvia Villa , Bang Công Vũ

In this paper, we extend the proximal point algorithm for vector optimization from the Euclidean space to the Riemannian context. Under suitable assumptions on the objective function the well definition and full convergence of the method to…

Optimization and Control · Mathematics 2015-12-21 G. C. Bento , O. P. Ferreira , Y. R. L. Pereira

Machine learning approaches relying on such criteria as adversarial robustness or multi-agent settings have raised the need for solving game-theoretic equilibrium problems. Of particular relevance to these applications are methods targeting…

Machine Learning · Computer Science 2023-10-27 Xufeng Cai , Ahmet Alacaoglu , Jelena Diakonikolas

Robust optimization provides a principled and unified framework to model many problems in modern operations research and computer science applications, such as risk measures minimization and adversarially robust machine learning. To use a…

Optimization and Control · Mathematics 2024-10-04 Hao Hao , Peter Zhang

We propose conformal hyperrectangular prediction regions for multi-target regression. We propose split conformal prediction algorithms for both point and quantile regression to form hyperrectangular prediction regions, which allow for easy…

Methodology · Statistics 2024-06-10 Max Sampson , Kung-Sik Chan

A generalization of a viscosity generalized Halpern iteration scheme is analyzed. It is proven that the solution converges asymptotically strongly to a unique fixed point of an asymptotically nonexpansive mapping which drives the iteration…

Functional Analysis · Mathematics 2009-02-18 M. De la Sen

In this paper we study the convergence of an iterative algorithm for finding zeros with constraints for not necessarily monotone set-valued operators in a reflexive Banach space. This algorithm, which we call the proximal-projection method…

Exactly Solvable and Integrable Systems · Physics 2007-11-16 Dan Butnariu , Gabor Kassay

We study the asymptotic consistency properties of $\alpha$-R\'enyi approximate posteriors, a class of variational Bayesian methods that approximate an intractable Bayesian posterior with a member of a tractable family of distributions, the…

Statistics Theory · Mathematics 2020-08-17 Prateek Jaiswal , Vinayak A. Rao , Harsha Honnappa

In this paper we establish an estimate for the rate of convergence of the Krasnosel'ski\v{\i}-Mann iteration for computing fixed points of non-expansive maps. Our main result settles the Baillon-Bruck conjecture [3] on the asymptotic…

Optimization and Control · Mathematics 2013-10-09 Roberto Cominetti , José A. Soto , José Vaisman

Alternative iterative methods for a nonexpansive mapping in a Banach space are proposed and proved to be convergent to a common solution to a fixed point problem and a variational inequality. We give rates of asymptotic regularity for such…

Functional Analysis · Mathematics 2009-06-01 Vittorio Colao , Laurentiu Leustean , Genaro Lopez , Victoria Martin-Marquez