English
Related papers

Related papers: Extrapolation and Local Acceleration of an Iterati…

200 papers

In this paper we consider $l_0$ regularized convex cone programming problems. In particular, we first propose an iterative hard thresholding (IHT) method and its variant for solving $l_0$ regularized box constrained convex programming. We…

Optimization and Control · Mathematics 2012-11-05 Zhaosong Lu

In approximating solutions of nonstationary problems, various approaches are used to compute the solution at a new time level from a number of simpler (sub-)problems. Among these approaches are splitting methods. Standard splitting schemes…

Numerical Analysis · Mathematics 2020-08-20 Yalchin Efendiev , Petr N. Vabishchevich

Local fractional derivative and integrals are revealed as one of useful tools to deal with everywhere continuous but nowhere differentiable functions in fractal areas ranging from fundamental science to engineering. In this paper, a…

Mathematical Physics · Physics 2012-06-25 Yang Xiao-Jun

We derive computationally tractable methods to select a small subset of experiment settings from a large pool of given design points. The primary focus is on linear regression models, while the technique extends to generalized linear models…

Machine Learning · Statistics 2017-12-21 Yining Wang , Adams Wei Yu , Aarti Singh

We consider a scalar objective minimization problem over the solution set of another optimization problem. This problem is known as simple bilevel optimization problem and has drawn a significant attention in the last few years. Our inner…

Optimization and Control · Mathematics 2018-09-18 Yekini Shehu , Phan Tu Vuong , Alain Zemkoho

Properties of compositions and convex combinations of averaged nonexpansive operators are investigated and applied to the design of new fixed point algorithms in Hilbert spaces. An extended version of the forward-backward splitting…

Functional Analysis · Mathematics 2014-10-09 Patrick L. Combettes , Isao Yamada

This paper considers the iterative solution of linear systems arising from discretization of the anisotropic radiative transfer equation with discontinuous elements on the sphere. In order to achieve robust convergence behavior in the…

Numerical Analysis · Mathematics 2021-03-11 Jürgen Dölz , Olena Palii , Matthias Schlottbom

We introduce a cutting-plane framework for nonconvex quadratic programs (QPs) that progressively tightens convex relaxations. Our approach leverages the doubly nonnegative (DNN) relaxation to compute strong lower bounds and generate…

Optimization and Control · Mathematics 2025-10-06 Zheng Qu , Defeng Sun , Jintao Xu

Motivated by federated learning, we consider the hub-and-spoke model of distributed optimization in which a central authority coordinates the computation of a solution among many agents while limiting communication. We first study some past…

Machine Learning · Computer Science 2020-05-12 Reese Pathak , Martin J. Wainwright

In this paper we consider a general problem set-up for a wide class of convex and robust distributed optimization problems in peer-to-peer networks. In this set-up convex constraint sets are distributed to the network processors who have to…

Systems and Control · Computer Science 2013-12-02 Mathias Bürger , Giuseppe Notarstefano , Frank Allgöwer

We establish local linear convergence bounds for the ISTA and FISTA iterations on the model LASSO problem. We show that FISTA can be viewed as an accelerated ISTA process. Using a spectral analysis, we show that, when close enough to the…

Optimization and Control · Mathematics 2015-01-14 Shaozhe Tao , Daniel Boley , Shuzhong Zhang

A trajectory-following primal--dual interior-point method solves nonlinear optimization problems with inequality and equality constraints by approximately finding points satisfying perturbed Karush--Kuhn--Tucker optimality conditions for a…

Optimization and Control · Mathematics 2025-07-03 Pim Heeman , Anders Forsgren

This paper addresses the numerical solution of the matrix square root problem. Two fixed point iterations are proposed by rearranging the nonlinear matrix equation $A - X^2 = 0$ and incorporating a positive scaling parameter. The proposals…

Numerical Analysis · Mathematics 2020-02-21 Harry F. Oviedo , Hugo J. Lara , Oscar S. Dalmau

Many problems reduce to the fixed-point problem of solving $x=T(x)$. To this problem, we apply the coordinate-update algorithms, which update only one or a few components of $x$ at each step. When each update is cheap, these algorithms are…

Optimization and Control · Mathematics 2017-03-06 Yat Tin Chow , Tianyu Wu , Wotao Yin

In this paper, we study the nonexpansive properties of metric resolvent, and present a convergence rate analysis for the associated fixed-point iterations (Banach-Picard and Krasnosel'skii-Mann types). Equipped with a variable metric, we…

Optimization and Control · Mathematics 2021-09-14 Feng Xue

In general there exists no relationship between the fixed point sets of the composition and of the average of a family of nonexpansive operators in Hilbert spaces. In this paper, we establish an asymptotic principle connecting the cycles…

Functional Analysis · Mathematics 2013-04-29 J. -B. Baillon , P. L. Combettes , R. Cominetti

In this study, we introduce a new iterative processes to approximate common fixed points of an infinite family of quasi-nonexpansive mappings and obtain a strongly convergent iterative sequence to the common fixed points of these mappings…

Functional Analysis · Mathematics 2015-02-24 K. Dogan , V. Karakaya

We describe a new method to compute general cubature formulae. The problem is initially transformed into the computation of truncated Hankel operators with flat extensions. We then analyse the algebraic properties associated to flat…

Algebraic Geometry · Mathematics 2015-06-10 Marta Abril Bucero , Chandrajit Bajaj , Bernard Mourrain

The method of sub-iteration, which was previously applied to the higher-order coupled cluster amplitude equations, is extended to the case of the coupled cluster $\Lambda$ equations. The sub-iteration procedure for the $\Lambda$ equations…

Chemical Physics · Physics 2025-03-26 Devin A. Matthews

Motivated by Pryce's structural index reduction method for differential algebraic equations (DAEs), we show the complexity of the fixed-point iteration algorithm and propose a fixed-point iteration method with parameters. It leads to a…

Numerical Analysis · Computer Science 2014-12-22 Juan Tang , Wenyuan Wu , Xiaolin Qin , Yong Feng