English
Related papers

Related papers: An Update-and-Stabilize Framework for the Minimum-…

200 papers

In this work, in the context of Linear and Quadratic Programming, we interpret Primal Dual Regularized Interior Point Methods (PDR-IPMs) in the framework of the Proximal Point Method. The resulting Proximal Stabilized IPM (PS-IPM) is…

Optimization and Control · Mathematics 2022-05-05 Stefano Cipolla , Jacek Gondzio

We propose a loop optimization algorithm based on nuclear norm regularization for tensor network. The key ingredient of this scheme is to introduce a rank penalty term proposed in the context of data processing. Compared to standard…

Statistical Mechanics · Physics 2024-11-07 Kenji Homma , Tsuyoshi Okubo , Naoki Kawashima

Sparsity is a highly desired feature in deep neural networks (DNNs) since it ensures numerical efficiency, improves the interpretability of models (due to the smaller number of relevant features), and robustness. For linear models, it is…

Machine Learning · Computer Science 2024-04-01 Augustina C. Amakor , Konstantin Sonntag , Sebastian Peitz

In model predictive control (MPC) an optimization problem has to be solved at each time step, which in real-time applications makes it important to solve these optimization problems efficiently and to have good upper bounds on worst-case…

Optimization and Control · Mathematics 2020-04-13 Daniel Arnström , Daniel Axehill

Nowadays, analysing data from different classes or over a temporal grid has attracted a great deal of interest. As a result, various multiple graphical models for learning a collection of graphical models simultaneously have been derived by…

Optimization and Control · Mathematics 2021-04-23 Ning Zhang , Yangjing Zhang , Defeng Sun , Kim-Chuan Toh

The linearly constrained matrix rank minimization problem is widely applicable in many fields such as control, signal processing and system identification. The tightest convex relaxation of this problem is the linearly constrained nuclear…

Optimization and Control · Mathematics 2009-05-12 Shiqian Ma , Donald Goldfarb , Lifeng Chen

In this work, we examine a numerical phase-field fracture framework in which the crack irreversibility constraint is treated with a primal-dual active set method and a linearization is used in the degradation function to enhance the…

Numerical Analysis · Mathematics 2023-07-05 Leon Maximilian Kolditz , Katrin Mang , Thomas Wick

In this work, we propose an optimization framework for estimating a sparse robust one-dimensional subspace. Our objective is to minimize both the representation error and the penalty, in terms of the l1-norm criterion. Given that the…

Machine Learning · Statistics 2024-03-07 Xiao Ling , Paul Brooks

This paper investigates theoretical properties and efficient numerical algorithms for the so-called elastic-net regularization originating from statistics, which enforces simultaneously l^1 and l^2 regularization. The stability of the…

Numerical Analysis · Mathematics 2015-05-13 Bangti Jin , Dirk Lorenz , Stefan Schiffler

This paper presents a novel approach to solving large-scale minimax problems with nonsmooth regularizers. We propose a stochastic implicit proximal point algorithm with variance reduction techniques where stochastic oracles are selected in…

Optimization and Control · Mathematics 2026-05-25 Kehan Zhu , Jiani Wang , Yu-Hong Dai

We extend a primal-dual fixed point algorithm (PDFP) proposed in [5] to solve two kinds of separable multi-block minimization problems, arising in signal processing and imaging science. This work shows the flexibility of applying PDFP…

Optimization and Control · Mathematics 2016-02-02 Peijun Chen , Jianguo Huang , Xiaoqun Zhang

For three decades, carrier-phase observations have been used to obtain the most accurate location estimates using global navigation satellite systems (GNSS). These estimates are computed by minimizing a nonlinear mixed-integer least-squares…

Signal Processing · Electrical Eng. & Systems 2026-01-01 Ophir Uziel , Efi Fogel , Dan Halperin , Sivan Toledo

In this paper we study general $l_p$ regularized unconstrained minimization problems. In particular, we derive lower bounds for nonzero entries of first- and second-order stationary points, and hence also of local minimizers of the $l_p$…

Optimization and Control · Mathematics 2012-10-02 Zhaosong Lu

We provide an algorithm which, with high probability, maintains a $(1-\epsilon)$-approximate maximum flow on an undirected graph undergoing $m$-edge additions in amortized $m^{o(1)} \epsilon^{-3}$ time per update. To obtain this result, we…

Data Structures and Algorithms · Computer Science 2023-11-07 Jan van den Brand , Li Chen , Rasmus Kyng , Yang P. Liu , Richard Peng , Maximilian Probst Gutenberg , Sushant Sachdeva , Aaron Sidford

In this paper, a multi-parameterized proximal point algorithm combining with a relaxation step is developed for solving convex minimization problem subject to linear constraints. We show its global convergence and sublinear convergence rate…

Numerical Analysis · Mathematics 2019-07-11 Jianchao Bai , Ke Guo , Xiaokai Chang

In this paper we present an efficient active-set method for the solution of convex quadratic programming problems with general piecewise-linear terms in the objective, with applications to sparse approximations and risk-minimization. The…

Optimization and Control · Mathematics 2024-05-08 Spyridon Pougkakiotis , Jacek Gondzio , Dionysis Kalogerias

Nonsmooth nonconvex optimization problems involving the $\ell^p$ quasi-norm, $p \in (0, 1]$, of a linear map are considered. A monotonically convergent scheme for a regularized version of the original problem is developed and necessary…

Optimization and Control · Mathematics 2017-09-20 Daria Ghilli , Karl Kunisch

This paper treats the problem of minimizing a general continuously differentiable function subject to sparsity constraints. We present and analyze several different optimality criteria which are based on the notions of stationarity and…

Information Theory · Computer Science 2012-03-22 Amir Beck , Yonina C. Eldar

We consider a regularization concept for the solution of ill--posed operator equations, where the operator is composed of a continuous and a discontinuous operator. A particular application is level set regularization, where we develop a…

Numerical Analysis · Mathematics 2020-11-16 F. Frühauf , O. Scherzer , A. Leitao

In tensor completion, the latent nuclear norm is commonly used to induce low-rank structure, while substantially failing to capture the global information due to the utilization of unbalanced unfolding scheme. To overcome this drawback, a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Jinshi Yu , Weijun Sun , Yuning Qiu , Shengli Xie