English
Related papers

Related papers: A hybrid algorithm for the two-trust-region subpro…

200 papers

We present an efficient alternating direction method of multipliers (ADMM) algorithm for segmenting a multivariate non-stationary time series with structural breaks into stationary regions. We draw from recent work where the series is…

Machine Learning · Statistics 2018-06-26 Alex Tank , Emily B. Fox , Ali Shojaie

We consider the solution of linear saddle-point problems, using the alternating direction method-of-multipliers (ADMM) as a preconditioner for the generalized minimum residual method (GMRES). We show, using theoretical bounds and empirical…

Optimization and Control · Mathematics 2016-04-28 Richard Y. Zhang , Jacob K. White

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

Optimization and Control · Mathematics 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

We present the Trust Region Adversarial Functional Subdifferential (TRAFS) algorithm for constrained optimization of nonsmooth convex Lipschitz functions. Unlike previous methods that assume a subgradient oracle model, we work with the…

Optimization and Control · Mathematics 2024-01-30 Kai Jia , Martin Rinard

We consider a class of integer-constrained optimization problems governed by partial differential equation (PDE) constraints and regularized via total variation (TV) in the context of topology optimization. The presence of discrete design…

Optimization and Control · Mathematics 2025-09-25 Harsh Choudhary , Sven Leyffer , Dominic Yang

We consider the minimization of a cost function $f$ on a manifold $M$ using Riemannian gradient descent and Riemannian trust regions (RTR). We focus on satisfying necessary optimality conditions within a tolerance $\varepsilon$.…

Optimization and Control · Mathematics 2018-05-01 Nicolas Boumal , P. -A. Absil , Coralia Cartis

Non-convex quadratically constrained quadratic programming (QCQP) problems have numerous applications in signal processing, machine learning, and wireless communications, albeit the general QCQP is NP-hard, and several interesting special…

Optimization and Control · Mathematics 2016-09-21 Kejun Huang , Nicholas D. Sidiropoulos

Binary trust-region steepest descent (BTR) and combinatorial integral approximation (CIA) are two recently investigated approaches for the solution of optimization problems with distributed binary-/discrete-valued variables (control…

Optimization and Control · Mathematics 2024-02-14 Paul Manns , Mirko Hahn , Christian Kirches , Sven Leyffer , Sebastian Sager

We consider an $\ell_0$-minimization problem where $f(x) + \gamma \|x\|_0$ is minimized over a polyhedral set and the $\ell_0$-norm regularizer implicitly emphasizes sparsity of the solution. Such a setting captures a range of problems in…

Optimization and Control · Mathematics 2019-12-19 Yue Xie , Uday V. Shanbhag

The total least squares problem with the general Tikhonov regularization can be reformulated as a one-dimensional parametric minimization problem (PM), where each parameterized function evaluation corresponds to solving an n-dimensional…

Optimization and Control · Mathematics 2018-10-30 Yong Xia , Longfei Wang , Meijia Yang

This paper discusses a consensus-based alternating direction method of multipliers (ADMM) approach to solve the multi-area coordinated network-constrained unit commitment (NCUC) problem in a distributed manner. Due to political and…

Optimization and Control · Mathematics 2018-01-23 Yamin Wang , Lei Wu , Jie Li

We introduce a variant of the proximal gradient method in which the quadratic term is diagonal but may be indefinite, and is safeguarded by a trust region. Our method is a special case of the proximal quasi-Newton trust-region method of…

Optimization and Control · Mathematics 2023-09-18 Geoffroy Leconte , Dominique Orban

The Alternating Direction Method of Multipliers (ADMM) provides a natural way of solving inverse problems with multiple partial differential equations (PDE) forward models and nonsmooth regularization. ADMM allows splitting these…

Numerical Analysis · Mathematics 2021-04-29 Luke Lozenski , Umberto Villa

In this paper, we develop a dual alternating direction method of multipliers (ADMM) for an image decomposition model. In this model, an image is divided into two meaningful components, i.e., a cartoon part and a texture part. The…

Image and Video Processing · Electrical Eng. & Systems 2024-12-20 Qingsong Wang , Chengjing Wang , Peipei Tang , Dunbiao Niu

We consider the minimization of non-convex functions that typically arise in machine learning. Specifically, we focus our attention on a variant of trust region methods known as cubic regularization. This approach is particularly attractive…

Machine Learning · Computer Science 2017-07-04 Jonas Moritz Kohler , Aurelien Lucchi

There has been growing interest in high-order tensor methods for nonconvex optimization, with adaptive regularization, as they possess better/optimal worst-case evaluation complexity globally and faster convergence asymptotically. These…

Optimization and Control · Mathematics 2025-01-17 Coralia Cartis , Wenqi Zhu

We introduce a family of numerical algorithms for the solution of linear system in higher dimensions with the matrix and right hand side given and the solution sought in the tensor train format. The proposed methods are rank--adaptive and…

Numerical Analysis · Mathematics 2014-10-07 Sergey V. Dolgov , Dmitry V. Savostyanov

In this paper, we present a semi-proximal alternating direction method of multipliers (ADMM) for solving $3$-block separable convex minimization problems with the second block in the objective being a strongly convex function and one…

Optimization and Control · Mathematics 2015-06-24 Min Li , Defeng Sun , Kim-Chuan Toh

In this paper, we propose an algorithmic framework, dubbed inertial alternating direction methods of multipliers (iADMM), for solving a class of nonconvex nonsmooth multiblock composite optimization problems with linear constraints. Our…

Optimization and Control · Mathematics 2023-01-26 Le Thi Khanh Hien , Duy Nhat Phan , Nicolas Gillis

We consider a novel algorithm, for the completion of partially observed low-rank tensors, as a generalization of matrix completion. The proposed low-rank tensor completion (TC) method builds on the conventional nuclear norm (NN)…

Machine Learning · Statistics 2026-05-06 Niclas Führling , Getuar Rexhepi , Giuseppe Thadeu Freitas de Abreu