English
Related papers

Related papers: Projective Splitting as a Warped Proximal Algorith…

200 papers

For the inclusion problem involving two maximal monotone operators, under the metric subregularity of the composite operator, we derive the linear convergence of the generalized proximal point algorithm and several splitting algorithms,…

Optimization and Control · Mathematics 2016-09-28 Li Shen , Shaohua Pan

The split feasibility problem is to find an element in the intersection of a closed set $C$ and the linear preimage of another closed set $D$, assuming the projections onto $C$ and $D$ are easy to compute. This class of problems arises…

Optimization and Control · Mathematics 2020-11-05 Chen Chen , Ting Kei Pong , Lulin Tan , Liaoyuan Zeng

Many problems arising in image processing and signal recovery with multi-regularization can be formulated as minimization of a sum of three convex separable functions. Typically, the objective function involves a smooth function with…

Optimization and Control · Mathematics 2016-01-01 Peijun Chen , Jianguo Huang , Xiaoqun Zhang

This paper aims to investigate the distributed stochastic optimization problems on compact embedded submanifolds (in the Euclidean space) for multi-agent network systems. To address the manifold structure, we propose a distributed…

Optimization and Control · Mathematics 2025-10-28 Jishu Zhao , Xi Wang , Jinlong Lei , Shixiang Chen

In this paper, we propose a novel extrapolation coefficient scheme within a new extrapolation term and develop an accelerated proximal gradient algorithm. We establish that the algorithm achieves a sublinear convergence rate. The proposed…

Optimization and Control · Mathematics 2025-10-17 Chengzhi Huang

Online optimisation revolves around new data being introduced into a problem while it is still being solved; think of deep learning as more training samples become available. We adapt the idea to dynamic inverse problems such as video…

Optimization and Control · Mathematics 2021-01-06 Tuomo Valkonen

We study preconditioned gradient-based optimization methods where the preconditioning matrix has block-diagonal form. Such a structural constraint comes with the advantage that the update computation is block-separable and can be…

Machine Learning · Computer Science 2020-12-08 Celestine Mendler-Dünner , Aurelien Lucchi

We propose a new algorithm---Stochastic Proximal Langevin Algorithm (SPLA)---for sampling from a log concave distribution. Our method is a generalization of the Langevin algorithm to potentials expressed as the sum of one stochastic smooth…

Machine Learning · Statistics 2020-06-17 Adil Salim , Dmitry Kovalev , Peter Richtárik

In this paper, we propose a new decomposition approach named the proximal primal dual algorithm (Prox-PDA) for smooth nonconvex linearly constrained optimization problems. The proposed approach is primal-dual based, where the primal step…

Optimization and Control · Mathematics 2016-04-05 Mingyi Hong

A parallel splitting method is proposed for solving systems of coupled monotone inclusions in Hilbert spaces. Convergence is established for a wide class of coupling schemes. Unlike classical alternating algorithms, which are limited to two…

Optimization and Control · Mathematics 2009-02-26 H. Attouch , L. M. Briceno-Arias , P. L. Combettes

In this paper, we introduce two parallel extragradient-proximal methods for solving split equilibrium problems. The algorithms combine the extragradient method, the proximal method and the hybrid (outer approximation) method. The weak and…

Optimization and Control · Mathematics 2015-11-10 Dang Van Hieu

Many realistic decision-making problems in networked scenarios, such as formation control and collaborative task offloading, often involve complicatedly entangled local decisions, which, however, have not been sufficiently investigated yet.…

Optimization and Control · Mathematics 2025-11-20 Dandan Wang , Xuyang Wu , Zichong Ou , Jie Lu

We consider the problem of sampling from a posterior distribution arising in Bayesian inverse problems in science, engineering, and imaging. Our method belongs to the family of independence Metropolis-Hastings (IMH) sampling algorithms,…

Machine Learning · Computer Science 2026-05-19 Youguang Chen , George Biros

By time discretization of a second-order primal-dual dynamical system with damping $\alpha/t$ where an inertial construction in the sense of Nesterov is needed only for the primal variable, we propose a fast primal-dual algorithm for a…

Optimization and Control · Mathematics 2022-06-06 Xin He , Rong Hu , Ya-Ping Fang

We introduce computable projection operators onto piecewise polynomial spaces, defined via sampling and discrete least-squares polynomial approximations. The resulting mappings exhibit (almost) optimal approximation properties in $L^2$ and…

Numerical Analysis · Mathematics 2026-02-05 Johannes Storn

In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach exploits closed-form…

Machine Learning · Statistics 2015-06-02 Nicholas G. Polson , James G. Scott , Brandon T. Willard

We consider minimization of the sum of a large number of convex functions, and we propose an incremental aggregated version of the proximal algorithm, which bears similarity to the incremental aggregated gradient and subgradient methods…

Systems and Control · Computer Science 2015-11-05 Dimitri P. Bertsekas

Next generation radio telescopes, like the Square Kilometre Array, will acquire an unprecedented amount of data for radio astronomy. The development of fast, parallelisable or distributed algorithms for handling such large-scale data sets…

Instrumentation and Methods for Astrophysics · Physics 2016-10-28 Alexandru Onose , Rafael E. Carrillo , Jason D. McEwen , Yves Wiaux

We introduce the first probabilistic framework tailored for sequential random projection, an approach rooted in the challenges of sequential decision-making under uncertainty. The analysis is complicated by the sequential dependence and…

Statistics Theory · Mathematics 2024-05-14 Yingru Li

We propose an approximation scheme for a class of semilinear variational inequalities whose Hamiltonian is convex and coercive. The proposed scheme is a natural extension of a previous splitting scheme proposed by Liang, Zariphopoulou and…

Numerical Analysis · Mathematics 2019-11-05 Shuo Huang