English
Related papers

Related papers: Extrapolated Hard Thresholding Algorithms with Fin…

200 papers

We present an algorithm based on continuation techniques that can be applied to solve numerically minimization problems with equality constraints. We focus on problems with a great number of local minima which are hard to obtain by local…

Numerical Analysis · Mathematics 2019-09-17 Elisabete Alberdi , Mikel Antoñana , Joseba Makazaga , Ander Murua

Finding the sparse solution of an underdetermined system of linear equations has many applications, especially, it is used in Compressed Sensing (CS), Sparse Component Analysis (SCA), and sparse decomposition of signals on overcomplete…

Information Theory · Computer Science 2010-01-29 Hosein Mohimani , Massoud Babaie-Zadeh , Irina Gorodnitsky , Christian Jutten

We consider an optimization problem with strongly convex objective and linear inequalities constraints. To be able to deal with a large number of constraints we provide a penalty reformulation of the problem. As penalty functions we use a…

Optimization and Control · Mathematics 2020-04-29 Angelia Nedich , Tatiana Tatarenko

This paper deals with an inertial proximal algorithm that contains a Tikhonov regularization term, in connection to the minimization problem of a convex lower semicontinuous function $f$. We show that for appropriate Tikhonov regularization…

Optimization and Control · Mathematics 2024-01-09 Szilárd Csaba László

In this two-part study we develop a general approach to the design and analysis of exact penalty functions for various optimal control problems, including problems with terminal and state constraints, problems involving differential…

Optimization and Control · Mathematics 2020-01-10 M. V. Dolgopolik , A. V. Fominyh

In this paper, we propose first-order feasible methods for difference-of-convex (DC) programs with smooth inequality and simple geometric constraints. Our strategy for maintaining feasibility of the iterates is based on a "retraction" idea…

Optimization and Control · Mathematics 2022-12-05 Yongle Zhang , Guoyin Li , Ting Kei Pong , Shiqi Xu

In this paper, a continuous and non-convex promoting sparsity fraction function is studied in two sparse portfolio selection models with and without short-selling constraints. Firstly, we study the properties of the optimal solution to the…

Optimization and Control · Mathematics 2018-01-30 Angang Cui , Jigen Peng , Chengyi Zhang , Haiyang Li , Meng Wen

The error exponent in lossy source coding characterizes the asymptotic decay rate of error probability with respect to blocklength. The Marton's error exponent provides the theoretically optimal bound on this rate. However, computation…

Information Theory · Computer Science 2025-07-29 Jiachuan Ye , Shitong Wu , Lingyi Chen , Wenyi Zhang , Huihui Wu , Hao Wu

In this work, we analyse the links between ghost penalty stabilisation and aggregation-based discrete extension operators for the numerical approximation of elliptic partial differential equations on unfitted meshes. We explore the behavior…

Numerical Analysis · Mathematics 2021-11-24 Santiago Badia , Eric Neiva , Francesc Verdugo

We present a new algorithm and the corresponding convergence analysis for the regularization of linear inverse problems with sparsity constraints, applied to a new generalized sparsity promoting functional. The algorithm is based on the…

Numerical Analysis · Mathematics 2016-12-30 Sergey Voronin , Ingrid Daubechies

Fixed-point equations with Lipschitz operators have been studied for more than a century, and are central to problems in mathematical optimization, game theory, economics, and dynamical systems, among others. When the Lipschitz constant of…

Optimization and Control · Mathematics 2025-11-12 Jelena Diakonikolas

This paper studies sparse linear regression analysis with outliers in the responses. A parameter vector for modeling outliers is added to the standard linear regression model and then the sparse estimation problem for both coefficients and…

Statistics Theory · Mathematics 2015-05-21 Shota Katayama , Hironori Fujisawa

We establish linear convergence rates for a certain class of extrapolated fixed point algorithms which are based on dynamic string-averaging methods in a real Hilbert space. This applies, in particular, to the extrapolated simultaneous and…

Optimization and Control · Mathematics 2018-05-11 Christian Bargetz , Victor I. Kolobov , Simeon Reich , Rafał Zalas

In many iterative optimization methods, fixed-point theory enables the analysis of the convergence rate via the contraction factor associated with the linear approximation of the fixed-point operator. While this factor characterizes the…

Systems and Control · Electrical Eng. & Systems 2022-06-22 Trung Vu , Raviv Raich

We consider a class of difference-of-convex (DC) optimization problems whose objective is level-bounded and is the sum of a smooth convex function with Lipschitz gradient, a proper closed convex function and a continuous concave function.…

Optimization and Control · Mathematics 2017-06-23 Bo Wen , Xiaojun Chen , Ting Kei Pong

The paper presents two variants of a Krylov-Simplex iterative method that combines Krylov and simplex iterations to minimize the residual $r = b-Ax$. The first method minimizes $\|r\|_\infty$, i.e. maximum of the absolute residuals. The…

Numerical Analysis · Mathematics 2021-01-28 Wim Vanroose , Jeffrey Cornelis

Sparse clustering, which aims to find a proper partition of an extremely high-dimensional data set with redundant noise features, has been attracted more and more interests in recent years. The existing studies commonly solve the problem in…

Machine Learning · Statistics 2019-02-25 Xiangyu Chang , Yu Wang , Rongjian Li , Zongben Xu

We present a new family of min-max optimization algorithms that automatically exploit the geometry of the gradient data observed at earlier iterations to perform more informative extra-gradient steps in later ones. Thanks to this adaptation…

Optimization and Control · Mathematics 2020-11-20 Kimon Antonakopoulos , E. Veronica Belmega , Panayotis Mertikopoulos

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

Machine Learning · Statistics 2018-03-06 Brahim Khalil Abid , Robert M. Gower

This paper concerns a class of DC composite optimization problems which, as an extension of convex composite optimization problems and DC programs with nonsmooth components, often arises in robust factorization models of low-rank matrix…

Optimization and Control · Mathematics 2025-10-08 Ting Tao , Ruyu Liu , Shaohua Pan
‹ Prev 1 4 5 6 7 8 10 Next ›