English
Related papers

Related papers: Quantitative results on the multi-parameters Proxi…

200 papers

We investigate the properties of a sequential Monte Carlo method where the particle weight that appears in the algorithm is estimated by a positive, unbiased estimator. We present broadly-applicable convergence results, including a central…

Methodology · Statistics 2022-08-26 Paul B. Rohrbach , Robert L. Jack

Estimators derived from a divergence criterion such as $\varphi-$divergences are generally more robust than the maximum likelihood ones. We are interested in particular in the so-called MD$\varphi$DE, an estimator built using a dual…

Computation · Statistics 2016-06-14 Diaa Al Mohamad , Michel Broniatowski

Several optimization schemes have been known for convex optimization problems. However, numerical algorithms for solving nonconvex optimization problems are still underdeveloped. A progress to go beyond convexity was made by considering the…

Optimization and Control · Mathematics 2015-06-29 Nguyen Thai An , Nguyen Mau Nam

In this paper, we study the convergence properties of an iterative algorithm for fast nonlinear model predictive control of quasi-linear parameter-varying systems without inequality constraints. Compared to previous works considering this…

Optimization and Control · Mathematics 2023-09-15 Christian Hespe , Herbert Werner

The dominated convergence theorem implies that if (f_n) is a sequence of functions on a probability space taking values in the interval [0,1], and (f_n) converges pointwise a.e., then the sequence of integrals converges to the integral of…

Functional Analysis · Mathematics 2014-01-03 Jeremy Avigad , Edward Dean , Jason Rute

In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach exploits closed-form…

Machine Learning · Statistics 2015-06-02 Nicholas G. Polson , James G. Scott , Brandon T. Willard

This paper proposes uni-orthogonal and bi-orthogonal nonnegative matrix factorization algorithms with robust convergence proofs. We design the algorithms based on the work of Lee and Seung [1], and derive the converged versions by utilizing…

Machine Learning · Computer Science 2011-03-17 Andri Mirzal

In his recent research M. K. Tam (2018) considered a framework for the analysis of iterative algorithms which can be described in terms of a structured set-valued operator. At each point in the ambient space, the value of the operator can…

Optimization and Control · Mathematics 2023-04-20 Alexander J. Zaslavski

We prove novel convergence results for a stochastic proximal gradient algorithm suitable for solving a large class of convex optimization problems, where a convex objective function is given by the sum of a smooth and a possibly non-smooth…

Optimization and Control · Mathematics 2016-08-11 Lorenzo Rosasco , Silvia Villa , Bang Công Vũ

We show that a subclass of infinite-state probabilistic programs that can be modeled by probabilistic one-counter automata (pOC) admits an efficient quantitative analysis. In particular, we show that the expected termination time can be…

Formal Languages and Automata Theory · Computer Science 2011-02-15 Tomas Brazdil , Stefan Kiefer , Antonin Kucera

Finding a zero of a maximal monotone operator is fundamental in convex optimization and monotone operator theory, and \emph{proximal point algorithm} (PPA) is a primary method for solving this problem. PPA converges not only globally under…

Optimization and Control · Mathematics 2019-05-14 Guoyong Gu , Junfeng Yang

In this work, we analyze two of the most fundamental algorithms in geodesically convex optimization: Riemannian gradient descent and (possibly inexact) Riemannian proximal point. We quantify their rates of convergence and produce different…

Optimization and Control · Mathematics 2024-03-18 David Martínez-Rubio , Christophe Roux , Sebastian Pokutta

Our work presents a new iterative scheme to approximate the fixed points of nonexpansive mapping. The proposed algorithm is constructed to enhance convergence efficiency while preserving theoretical robustness. Under appropriate assumptions…

Functional Analysis · Mathematics 2026-01-12 Nida Izhar Mallick , Izhar Uddin

A classical method for risk-sensitive nonlinear control is the iterative linear exponential quadratic Gaussian algorithm. We present its convergence analysis from a first-order optimization viewpoint. We identify the objective that the…

Optimization and Control · Mathematics 2019-10-21 Vincent Roulet , Maryam Fazel , Siddhartha Srinivasa , Zaid Harchaoui

This paper deals with an inertial proximal algorithm that contains a Tikhonov regularization term, in connection to the minimization problem of a convex lower semicontinuous function $f$. We show that for appropriate Tikhonov regularization…

Optimization and Control · Mathematics 2024-01-09 Szilárd Csaba László

A generalized method of alternating resolvents was introduced by Boikanyo and Moro{\c s}anu as a way to approximate common zeros of two maximal monotone operators. In this paper we analyse the strong convergence of this algorithm under two…

Functional Analysis · Mathematics 2021-02-01 Bruno Dinis , Pedro Pinto

A quantum trajectory describes the evolution of a quantum system undergoing indirect measurement. In the discrete-time setting, the state of the system is updated by applying Kraus operators according to the measurement results. From an…

Quantum Physics · Physics 2022-04-04 Maël Bompais , Nina H. Amini , Clément Pellegrini

In this letter, an accelerated quadratic programming (QP) algorithm is proposed based on the proximal gradient method. The algorithm can achieve convergence rate $O(1/p^{\alpha})$, where $p$ is the iteration number and $\alpha$ is the given…

Optimization and Control · Mathematics 2022-01-25 Jia Wang , Ying Yang

We consider the problem of finding the minimizations of the sum of two convex functions and the composition of another convex function with a continuous linear operator from the view of fixed point algorithms based on proximity operators,…

Optimization and Control · Mathematics 2016-04-18 Meng Wen , Yu-Chao Tang , Jigen Peng

We investigate the modeling and the numerical solution of machine learning problems with prediction functions which are linear combinations of elements of a possibly infinite-dimensional dictionary. We propose a novel flexible composite…

Statistics Theory · Mathematics 2015-12-03 Patrick L. Combettes , Saverio Salzo , Silvia Villa